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FOREWORD 


A  primary  mission  of  the  U.S.  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences  (ARI)  PM  TRADE  Field  Unit  at 
Orlando  is  to  enhance  soldier  performance  by  obtaining  maximum 
training  value  from  Army  simulation  and  training  devices.  This 
research  investigated  the  use  of  three  devices  in  conducting  Mi 
tank  gunnery  training.  These  devices  were  two  part-task 
trainers,  VIGS  and  TOPGUN,  and  the  full-fidelity  institutional 
Conduct-of-Fire-Trainer  (ICOFT).  The  objectives  of  the  research 
were  to  determine  the  degree  of  gunnery  skills  transfer  between 
the  part-task  gunnery  trainers  and  the  full-fidelity  gunnery 
simulator  and  to  identify  possible  predictors  of  tank  gunnery 
performance.  ICOFT  criterion  performances  were  examined  for  two 
pretraining  groups  (either  TOPGUN  first,  then  VIGS,  or  VIGS 
first,  then  TOPGUN)  and  a  control  group  to  discover  which  pre¬ 
training  sequence  leads  to  better  performance. 

This  task  was  performed  under  contract  in  response  to  the 
joint  PM  TRADE  and  ARI  Broad  Agency  Announcement  (May  1988)  re¬ 
lating  to  the  production  of  more  efficient  and  effective  training 
systems  and  devices.  PM  TRADE  funded  and  administered  this  con¬ 
tract,  while  ARI  monitored  the  technical  aspects  of  the  research, 
providing  guidance  to  the  contractor  as  required.  The  research 
results  were  delivered  to  the  chief  of  PM  TRADE'S  Research  and 
Engineering  Division  and  to  the  PM  Close  Combat  Training  Systems. 

This  research  demonstrates  how  different  gunnery  trainers 
may  be  used  separately  or  together  to  improve  gunnery  skills.  It 
also  provides  support  for  using  less  expensive  part-task  devices 
for  training  basic  gunnery  skills  that  might  otherwise  require 
the  use  of  a  full-fidelity  simulator.  The  results  should  be  of 
interest  to  the  armor  school,  because  they  must  teach  basic  gun¬ 
nery  skills  to  their  students,  and  to  both  active  and  reserve 
armor  units  because  they  must  make  optimal  use  of  limited  train¬ 
ing  time  and  resources. 
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AN  ANALYSIS  OF  SKILL  TRANSFER  FOR  TANK  GUNNERY  PERFORMANCE  USING 
TOPGUN,  VIGS,  AND  ICOFT  TRAINERS 


EXECUTIVE  SUMMARY 


Research  Requirement: 

The  research  reported  here  represents  an  investigation  of 
the  training  effectiveness  of  two  part-task  tank  gunnery  training 
devices,  the  Videodisk  Gunnery  Simulator  (VIGS)  and  the  TOPGUN 
trainer.  Each  of  these  devices  is  designed  to  train  and  sustain 
Ml  tank  gunnery  skills. 

The  general  purposes  of  the  study  were  to  determine 

(1)  whether  performance  improves  during  TOPGUN  and  VIGS  training; 

(2)  whether  TOPGUN  performance  transfers  to  VIGS  performance,  and 

(3)  whether  TOPGUN  performance  transfers  to  gunnery  performance 
on  a  full-fidelity  trainer,  the  Institutional  Conduct-of-Fire 
Trainer  (ICOFT);  (4)  which  sequence  of  training  (TOPGUN  or  viGS- 
TOPGUN)  shows  better  transfer  to  ICOFT;  and  (5)  whether  selected 
aptitude,  ability,  motivational,  and  demographic  measures  predict 
TOPGUN,  VIGS,  and  ICOFT  performance. 


Procedure : 

Sixty  student  subjects  were  randomly  assigned  to  three 
groups.  Each  group  of  20  subjects  reported  for  approximately 
4  hours  of  pretesting  (Phase  I),  8  hours  of  training  and  transfer 
on  TOPGUN  and  VIGS  (Phases  2  and  3),  and  2  hours  of  ICOFT  testing 
(Phase  4).  Control  subjects'  procedures  were  the  same  except  no 
VIGS  or  TOPGUN  training  was  given,  in  Phase  1,  subjects  were 
screened  for  colorblindness,  then  completed  a  battery  of  predic¬ 
tor  tests  consisting  of  the  VISTECH  contrast  sensitivity  test 
(four  replications),  the  Automated  Performance  Test  System  (APTS, 
three  replications),  a  short  version  of  the  Armed  Services  Voca¬ 
tional  Aptitude  Battery  (ASVAB),  and  the  Work  and  Family  Orienta¬ 
tion  ( WOFO )  Questionnaire.  In  Phase  2,  the  two  experimental 
groups  (TOPGUN-first  and  VlGS-first)  received  two  training  trials 
per  day  for  2  days  on  either  TOPGUN  or  VIGS  and  then  were 
switched  to  the  alternate  device  for  training  on  the  following 
2  days  (Phase  3).  In  Phase  4,  all  subjects  received  approxi¬ 
mately  2.5  hours  of  familiarization  and  testing  on  the  ICOFT, 
then  completed  post-test  opinion  questionnaires. 

Performance  measures  for  TOPGUN  and  VIGS  included  elevation 
and  azimuth  aiming  errors  (in  mils),  time  to  fire  (time  from  pre¬ 
sentation  of  the  target  to  firing  the  first  round),  time  to  kill, 
first  round  hit  percentage,  and  a  composite  performance  score. 
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For  ICOFT,  time  to  fire,  time  to  kill,  hit  percentage,  and  two 
composite  performance  scores,  target  acquisition  (TA)  error  and 
reticle  aim  (RA)  score,  were  used. 


Findings : 

We  found  that  (1)  performance  improved  at  equal  rates  during 
TOPGUN  and  VIGS  training;  (2)  there  was  significant  transfer  be¬ 
tween  most  TOPGUN  and  VIGS  performances,  with  no  apparent  superi¬ 
ority  to  either  device;  (3)  except  for  speed  measures,  TOPGUN  and 
VIGS  training  transferred  to  ICOFT;  (4)  there  was  no  apparent 
difference  between  the  TOPGUN-VIGS  or  VIGS-TOPGUN  sequences  of 
training;  and  (5)  highly  reliable  predictors  (e.g.,  code  substi¬ 
tution  and  reaction  time  tests  from  APTS,  a  contrast  sensitivity 
test  from  VISTECH,  and  two  ASVAB  scores)  proved  to  be  the  best 
predictors  of  gunnery  performance  on  the  various  devices  despite 
generally  low  multiple  correlations. 


Utilization  of  Findings: 

Results  were  discussed  in  light  of  Boldovici's  (1987)  guide¬ 
lines  for  transfer  research  with  military  devices.  This  study 
particularly  confirms  Boldovici's  suggestions  that  future  re¬ 
search  of  tank  gunnery  trainers  should  pay  more  attention  to 
time-on-task  (i.e.,  stability  of  performance)  and  measurement 
reliability  to  increase  the  power  of  statistical  tests  and  ulti¬ 
mately  identify  the  critical  tank  gunnery  tasks  and  skills  that 
can  enhance  gunner  selection  and  training. 
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AN  ANALYSIS  OF  SKILL  TRANSFER  FOR  TANK  GUNNERY  PERFORMANCE 
USING  TOPGUN,  VIGS,  AND  ICOFT  TRAINERS 


INTRODUCTION 


Gunnery  Training  Using  Training  Devices 

The  primary  function  of  the  Army  is  to  train  and  maintain 
combat-ready  troops.  To  accomplish  effective  training  requires 
knowledge  of  which  soldiers  need  training,  which  tasks  need  to  be 
trained,  when  training  should  be  scheduled,  which  training 
devices  to  utilize,  and  how  much  training  is  needed  to  acquire 
and  maintain  proficiency  on  needed  skills. 

It  is  generally  recognized  (U.S.  Army  Armor  School,  1981) 
that,  because  of  high  ammunition  costs  and  limited  availability 
of  equipment  and  live-fire  ranges,  it  is  difficult  to  attain  and 
sustain  required  tank  gunnery  proficiency  levels.  For  these 
reasons,  considerable  attention  has  recently  focused  on  the 
development  of  tank  gunnery  training  devices  that  permit  extended 
firing  practice  while  saving  costly  ammunition  (Department  of  the 
Army, 1984;  U.S.  Army  Armor  Center,  1984). 

The  research  reported  here  represents  an  investigation  of 
the  training  effectiveness  of  two  of  these  devices,  the  Videodisk 
Gunnery  Simulator  (VIGS)  and  the  TOPGUN  trainer.  Each  of  these 
devices  is  designed  to  train  and  sustain  Ml  tank  gunnery  skills. 

VIGS .  The  Ml  VIGS  is  manufactured  by  E.C.C.  Corporation  in 
Orlando,  Florida,  and  is  designed  to  act  as  a  part-task  trainer 
for  Ml  or  M1A1  tank  gunners.  The  trainer  was  designed  to  train 
gunners  to  engage  targets  from  a  stationary  tank  as  a  substitute 
for  training  previously  provided  in  early  stages  of  the  annual 
gunnery  training  cycle  (Witmer,  1988).  VIGS  is  a  part-task, 
table-top  medium-fidelity  device  equipped  with  a  single  primary 
sight  and  many  of  the  switches  and  controls  that  are  used  in 
live-fire  engagements  (Witmer,  1988).  The  basic  components  of  the 
Ml  VIGS  are  shown  in  Figure  1.  The  components  include  a  gunner's 
console,  a  videodisk  player  for  generating  target  scenes,  and  a 
floppy  disk  drive  to  allow  software  control.  Optional  components 
used  in  a  prototype  research  version  of  the  Ml  VIGS  include  a 
separate  operator's  station  consisting  of  an  operator's  terminal 
for  initiating  engagements,  a  performance  monitor  for  observing 
the  gunner's  performance  in  real  time,  and  a  printer  for 
producing  a  hard  copy  of  the  gunner's  performance  (Witmer,  1988). 
These  components  are  illustrated  in  Figure  2. 

Witmer  (1988)  evaluated  the  training  and  transfer  between 
VIGS  and  the  Unit  Conduct  of  Fire  Trainer  (UCOFT),  which 
simulates  many  functions  of  the  actual  tank.  Using  twenty-four 
soldiers  with  no  previous  Ml  gunnery  experience,  divided  into  two 
groups  of  twelve,  Witmer  initially  trained  one  group  as  gunners 
on  the  VIGS  and  then  tested  on  UCOFT,  while  the  other  group 


Figure  2.  Ml  Videodisk  Gunnery  Simulator  Optional  Components 
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trained  on  UCOFT  and  then  were  tested  on  the  VIGS.  Although 
Witmer  found  significant  performance  improvements  on  each  device 
as  well  as  significant  correlations  between  UCOFT  and  VIGS 
performances,  prior  training  on  VIGS  did  not  result  in  increased 
performance  levels  on  UCOFT.  This  failure  of  skills  learned  on 
one  device  to  transfer  to  the  other  device  was  interpreted  as 
perhaps  being  due  to  insufficient  practice  on  the  first  device  or 
to  fundamental  differences  in  responses  required  by  the  two 
devices  (Witmer,  1988). 

TOPGUN.  The  TOPGUN  trainer  is  a  low  cost  tank  gunnery 
prototype,  designed  by  NKH  corporation  in  Carlsbad,  California, 
under  a  joint  ARI-DARPA  program.  Costing  about  $5,934  each, 

TOPGUN  is  an  arcade-type  part  task  trainer  for  the  gunner 
position  designed  as  a  sustainment  trainer  for  crewmen  already 
familiar  with  tank  gunnery  operations.  The  trainee  engages 
single,  multiple,  moving  and  stationary  targets  in  response  to  an 
automated  "tank  commander's"  instructions.  The  tank  commander  is 
TOPGUN' s  onboard  computer  which  evaluates  threats,  assigns  them 
priority,  and  directs  the  engagement  accordingly.  The  trainer  is 
an  updated  version  of  its  predecessor,  Battlesight,  yet  similar 
in  many  ways.  Figure  3  shows  the  side  view  of  the  TOPGUN 
simulator.  The  device  uses  computer-generated  graphics  and  sound 
effects.  The  nineteen-inch  color  cathode  ray  tube  (CRT)  is 
partially  masked  to  provide  two  distinct  display  areas,  a  reticle 
area  and  a  gaming  area  (Figure  4).  Gunner's  control  handles 
similar  to  those  found  in  the  Ml  tank  are  used  to  track  targets 
and  fire  main  gun  rounds. 

Although  TOPGUN  has  the  potential  capability  of  providing 
cost-effective,  home-station  gunnery  training  for  Reserve 
Component  (RC)  armor  crewmen  and  others,  no  empirical  data  exist 
at  present  to  examine  its  purported  capabilities.  Research 
programs  developed  by  the  Army  Research  Institute  at  Fort  Knox 
and  Boise  have  provided  preliminary  data  (Kraemer,  personal 
communication,  1988). 

The  only  preliminary  results  available  from  these  studies 
are  from  the  Gowen  Field  Training  Lab  (Boise)  where  a  training 
transfer  study  between  TOPGUN  and  COFT  was  conducted  (Kraemer, 
personal  communication,  1989).  Soldiers  in  the  experimental 
groups  received  either  one  or  three  sessions  of  TOPGUN  training 
prior  to  being  tested  on  the  COFT  simulator,  while  soldiers  in 
the  control  group  received  no  TOPGUN  training.  All  training  used 
the  gunner's  auxiliary  sight  (GAS)  rather  than  the  primary  sight 
because  it  is  more  difficult  to  train.  Results  demonstrated  that 
soldiers  who  received  prior  TOPGUN  training  performed  better  on 
COFT  using  stationary  targets,  while  no  transfer  was  shown  for 
moving  targets.  Although  data  showed  no  transfer  for  moving 
targets  as  a  whole,  there  were  several  possible  reasons  advanced 
for  the  lack  of  transfer.  First,  there  were  difficulties  involved 
in  using  the  auxiliary  sight.  For  example,  when  applying  manual 
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lead,  there  were  differences  in  average  target  speed  between 
TOPGUN  and  COFT  targets.  Also,  TOPGUN  has  a  narrower  field  of 
view  and  larger  reticle  than  COFT.  Overall,  learning  was 
demonstrated  across  sessions  for  all  types  of  targets  within 
TOPGUN,  and  performance  on  TOPGUN  did  correlate  with  performance 
on  COFT  for  both  speed  and  accuracy  measures.  Correlations  were 
higher  for  speed  than  accuracy  measures,  but  the  research  failed 
to  report  the  magnitude  or  significance  level  of  these 
correlations. 

UCOFT.  The  Ml  UCOFT  is  a  high-fidelity  trainer  that 
provides  practice  for  the  gunner  and -tank  commander  on  many  of 
the  required  gunnery  tasks.  The  major  UCOFT  components  are 
illustrated  in  Figure  5  and  include  an  instructor/operator's 
station,  and  enclosed  crew  station,  a  special  purpose  computer, 
and  a  general  purpose  computer  (Instructor's  Utilization 
Handbook,  1985).  The  instructor/operator ' s  station  contains 
separate  monitors  for  the  gunner's  and  tank  commander's  sights, 
an  instructor's  control  terminal,  and  a  printer.  The  tank 
gunner's  station,  illustrated  in  Figure  6,  contains  the  Gunner's 
Primary  Sight  (GPS),  the  Gunner's  Auxiliary  Sight  (GAS),  and 
nearly  all  the  switches  and  controls  used  by  the  gunner  in  the  Ml 
tank  (Witmer,  1988). 

Transfer  of  Training 

Transfer  of  training  is  central  to  the  evaluation  of  new 
training  devices  and  to  the  understanding  of  basic  learning 
phenomena  (Cormier  &  Hagman,  1987).  However,  there  have  been 
several  design  problems  with  past  studies  of  transfer  of  Army 
training  devices  (Boldovici,  1987;  Boldovici  &  Sabat,  1985). 

Among  these  are:  1 )  small  numbers  of  subjects  are  used  in  the 
comparison;  2)  subjects  are  not  matched  or  randomly  assigned;  3) 
groups  are  treated  differently  in  respects  other  than  those  under 
investigation;  4)  amount  of  practice  is  insufficient  to  affect 
proficiency;  5)  measurement  of  criterion  performance  is 
unreliable;  and  6)  inappropriate  analyses  are  used  to  estimate 
transfer.  While  the  first  three  of  these  problems  can  be 
eliminated  by  better  research  designs  and  more  careful 
application  of  those  designs  (Witmer,  1988),  other  sources  of 
error  are  more  problematic.  For  example,  Klausmeir  and  Goodwin 
(1966)  have  pointed  out  the  importance  of  demonstrating  that 
initial  learning  has  occurred  before  administering  tests  of 
training  transfer.  Initial  learning  can  be  demonstrated  in  two 
ways:  by  comparing  pre-training  and  post-training  scores  or  by 
measuring  performance  on  a  set  of  engagements  over  several 
repetitions.  Especially  difficult  is  the  inherent  unreliability 
of  many  criterion  tests,  such  as  live-fire  tests  where  weapon 
system  errors  reduce  target  hits  despite  correct  performance  by 
the  tank  crew  (cf.  Fingerman,  1978).  Demonstrating  transfer  of 
training  should  improve  when  evaluating  training  devices  as 
opposed  to  live  fire,  however,  because  of  improved  reliability  of 
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measurements  through  such  features  as  automated  scoring, 
recording  of  performance,  and  the  capability  to  present  the  same 
scenarios  under  constant  conditions  to  each  soldier  tested 
(Witmer,  1988).  Finally,  many  inappropriate  analyses  are  used  to 
estimate  transfer,  such  as  chi-square  analyses,  correlation 
coefficients,  and  various  transfer  formulas  (Boldovici,  1987). 
Gagne,  Foster,  and  Crowley  (1948)  note,  "The  utilization  of  raw 
score  values  to  express  transfer  is  a  procedure  which  has  a 
number  of  advantages,  chief  among  which  is  precision  of  meaning" 
(p.  98). 

With  these  guidelines  in  mind,  this  study  was  designed  to 
test  skill  acquisition  and  transfer  from  two  part-task  gunnery 
trainers,  TOPGUN  and  the  Videodisk  Gunnery  Simulator  (VIGS), 
delivered  in  two  different  sequences,  to  criterion  performance  on 
a  high-fidelity  tank  gunnery  trainer,  the  Conduct  of  Fire  Trainer 
(COFT) . 

Prediction  of  Performance 


A  secondary  question  of  interest  to  Army  training  systems 
managers  involves  determining  the  individual  difference  factors 
that  influence  training  device  performance.  Although  studies 
(e.g.,  Eaton,  Johnson,  &  Black,  1980)  have  found  few  predictors 
of  training  device  or  tank  performance  which  explain  significant 
amounts  of  criterion  variance,  in  many  cases  criteria  are  flawed 
by  unreliable  performance  measures  (Turnage,  Houser,  &  Hofmann, 
1987),  suggesting  that  improvement  in  performance  measurement 
reliability  can  unmask  individual  difference  predictors  (Turnage 
&  Lane,  1987). 

Measuring  and  predicting  complex  task  performance  such  as 
tank  gunnery  has  been  a  challenge  for  researchers  (Boldovici  & 
Kraemer,  1974;  Lane,  1986;  Turnage,  Houser,  &  Hofmann,  1987). 
Regardless  of  the  particular  setting,  there  are  certain  factors 
that  make  accurate  performance  measurement  troublesome,  including 
the  identification,  definition,  and  measurement  of  variables  that 
may  affect  gunnery  performance. 
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Figure  3.  Side  View  of  TOPGUN  Simulator 
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Figure  4.  TOPGUN  Display 
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Figure  6.  Unit  Conduct  -  of - Fire  Trainer  Gunner's  Station 


For  example,  the  selection  process  by  which  soldiers  are 
identified  for  tank  gunnery  assignment  must  rely  on  an  accurate 
assessment  of  the  skills  and  aptitudes  required  for  the  job. 

Black  and  Graham  (1987)  provide  a  sample  list  of  gunner 
aptitude/skill  requirements  for  gunnery  tasks  in  which  hand-eye 
coordination  is  related  to  target  tracking,  visual  acuity  to 
target  recognition,  intelligence  to  computer  procedures, 
perceptual  skills  to  target  identification,  and  reaction  time  to 
target  engagement.  They  speculate  that,  only  as  we  become 
proficient  in  determining  the  relative  effects  of  the  "aptitude 
pie”,  can  we  accurately  identify  personnel  who  will  become 
superior  performers  in  combat  situations.  However,  variables 
other  than  skills  and  abilities  can  have  marked  effects  on  a 
gunner's  performance.  These  factors  relate  to  training  and 
include  motivation,  amount  of  training,  and  type  of  training. 
Therefore,  in  this  study  a  sampling  of  these  variables  was  used 
to  predict  performances  on  gunnery  tasks  as  measured  by  the  three 
distinct  training  devices. 

In  the  past,  research  concerning  the  prediction  of  tank  crew 
performance  has  been  inconclusive  and  flawed  by  measurement 
problems.  Initial  efforts  to  evaluate  predictors  of  tank  gunnery 
performance  (e.g.,  Eaton,  1978;  Eaton,  Bessemer,  &  Kristiansen, 
1979;  Greenstein  &  Hughes,  1977)  found  that  paper-and-penci 1 
tests  resulted  in  few  significant  correlations  with  gunnery 
scores.  Black  and  Graham  (1987)  suggested  that  paper-and-penci 1 
tests  are  limited  "because  they  tap  only  perceptual  and/or 
cognitive  aptitudes,  not  the  additional  perceptual  motor  or 
psychomotor  components  of  gunnery"  (p.  5).  Job  sample  testing, 
which  consists  of  hands-on  tests  developed  to  measure  certain 
critical  aspects  of  the  gunner's  job  performance,  has  been  used 
in  recent  research  efforts.  Such  tests,  when  used  to  evaluate  Ml 
trainees  (e.g..  Biers  &  Sauer,  1982;  Campbell  &  Black,  1982; 
Eaton,  Johnson,  &  Black,  1980),  have  shown  better  prediction  of 
performance  by  job  incumbents  than  paper-and-pencil  tests  (Black 
&  Campbell,  1982).  In  general,  however,  neither  paper-and-pencil 
ability  measures  nor  job  sample  tests  have  been  particularly 
successful  in  predicting  gunnery  performances. 

To  date,  accurate  performance  measurement  of  gunnery  skills 
has  been  handicapped  by  the  lack  of  appropriate  criteria  against 
which  to  validate  predictor  tests.  Criterion  measures  used  in 
previous  studies  include  scores  from  live-fire  gunnery  exercises, 
Multiple  Integrated  Laser  Engagements  System  (MILES)  exercises, 
supervisory  ratings,  peer  ratings.  Skill  Qualification  Tests,  and 
others  (Black  &  Graham,  1987).  However,  there  are  numerous 
problems  associated  with  current  job  performance  criteria,  due 
mainly  to  their  inherent  low  reliabilities.  Reliability  can  be 
defined  as  the  extent  to  which,  when  performance  is  repeated,  the 
same  results  are  obtained.  In  many  cases,  however,  such  as  when 
scores  are  obtained  from  live-fire  gunnery  exercises,  measures  of 
an  individual's  performance  may  not  be  consistent  due  to  changes 


in  exercises,  ammunition  characteristics,  equipment  performance, 
and  firing  conditions.  Any  such  inconsistencies  reduce 
reliability  by  increasing  error  variance. 

The  effect  of  criterion  unreliability  is  best  illustrated  by 
Spearman's  (1904)  correction  for  attenuation  formula: 


\/ 

where  rxy  is  the  observed  relationship  between  a  predictor,  such 
as  an  ability  score,  and  a  criterion,  such  as  operational 
performance,  rxx  is  the  reliability  of  the  predictor,  ryy  is  the 
reliability  of  the  criterion,  and  Rt  is  the  true  relationship 
between  the  predictor  and  criterion. 

Embedded  within  Spearman's  formula  are  the  two  types  of 
reliability  that  are  necessary  for  accurate  task  performance 
measurement.  Both  are  forms  of  internal  reliability.  The  first, 
rxx,  or  predictor  reliability,  refers  to  the  stability  of  the 
predictor.  The  second,  ryy,  refers  to  criterion  reliability, 
where  "criterion''  is  generally  synonymous  with  operational 
performance,  particularly  in  military  training  situations.  To 
circumvent  the  problem  of  low  predictive  validity,  it  is 
necessary  to  improve  the  internal  reliability  of  either  the 
predictor  or  the  criterion  or  both.  In  most  cases,  it  is 
generally  recognized  that  modification  of  the  predictor  measure 
is  easier  and  less  costly  than  modification  of  the  criterion 
(Turnage,  Kennedy,  Gilson,  Bliss,  &  Nolan,  1988). 

One  method  in  particular  which  has  been  suggested  to 
alleviate  the  problems  associated  with  low  criterion  reliability 
has  been  the  use  of  surrogate  measurement  (Lane,  Kennedy,  & 

Jones,  1986).  Surrogate  measures,  while  related  to  the  construct 
of  interest,  do  not  involve  operations  in  common  with  the  actual 
performance  measures.  Through  this  method  of  "substitution" 
surrogate  measurement  predicts  portions  of  variance  on  the 
complex  criterion  task  by  performance  on  relatively  simple  tasks. 

For  surrogate  measurement  to  be  effective.  Lane  et  al. 

(1986)  suggest  five  characteristics  that  surrogate  measures 
should  demonstrate:  1)  stability,  2)  correlation  with  the 
performance  construct,  3)  sensitivity  to  the  factors  that  would 
normally  affect  operational  performance,  4)  increased 
reliability,  and  5)  minimal  use  of  training  time.  By  fulfilling 
these  requirements,  it  is  suggested  that  surrogate  measurement, 
while  practically  less  valid,  may  tap  more  of  the  true  variance 
of  a  field  measure,  due  to  its  greater  reliability. 
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Several  studies  (e.g.,  Kennedy,  Wilkes,  Dunlap  &  Kuntz, 

1987;  Turnage,  Kennedy,  Gilson,  Bliss,  &  Nolan,  1988)  have  shown 
that  stable  performance  measures  from  very  simple  tests  were 
strongly  related  to  global  measures  of  intelligence  and  to 
simulated  flight  performance,  thus  supporting  the  concept  of 
surrogate  measurement. 

In  the  present  study,  four  predictor  test  sets  were  used 
because  their  demonstrated  reliability  might  provide  better 
prediction  of  tank  gunnery  performance,  in  line  with  the 
statistical  assumptions  underlying  the  previously-described 
correction-f or-attenuation  formula.  Tests  were  selected  to 
measure  the  fullest  possible  range  of  perceptual,  cognitive, 
psychomotor,  and  motivational  factors  predictive  of  tank  gunnery 
performance.  In  addition,  three  gunnery  simulators  which  might  be 
expected  to  accurately  predict  live-fire  tank  gunnery  proficiency 
were  used  to  provide  criteria  of  gunnery  performance.  Based  on 
Hoffman  and  Morrison's  (1988)  and  Morrison  and  Hoffman's  (1987) 
analyses  of  requirements  for  a  device-based  training  and  testing 
program  for  Ml  Gunnery,  preliminary  analyses  sought  to  define  the 
domain  cf  gunnery  in  terms  of  individual  conditions  and  actions 
and  evo 'nation  oi  trainability  on  TOPGUN  and  VIGS  (Appendix  A, 
Appendix  ti),  to  update  a  task  analysis  of  trainable  behaviors  on 
TOPGUN,  VIGS,  and  COFT  (Appendix  C),  and  to  determine  the  overall 
rankings  of  task  transferability  by  broad  categories  as  well  as 
list  untrainable  behaviors  (Appendix  D).  Because  all  three 
simulators  were  designed  to  train  tank  gunnery  performance, 
performances  measured  on  one  device  should  predict  performances 
on  the  other  devices. 

It  was  expected  that  the  selection  of  reliable,  task-related 
predictors  and  the  use  of  training  simulators  to  provide  criteria 
which  are  more  reliable  than  live-combat  criteria  would  provide 
more  valid  selection  and  training  prediction  of  gunnery  personnel 
by  indicating  the  required  skill/aptitude  substrates  of 
proficient  performance. 

Research  Objectives 


The  general  purposes  of  this  study  were  to  determine:  (1) 
whether  TOPGUN  training  performance  transfers  to  VIGS  gunnery 
performance,  and  vice  versa;  (2)  how  TOPGUN  and  VIGS  learning 
progresses  over  repeated  trials,  and  how  much  TOPGUN  and  VIGS 
training  is  required  to  promote  effective  transfer;  (3)  the 
degree  of  transfer  from  two  part-task  gunnery  trainers  (TOPGUN 
and  VIGS)  to  a  high-fidelity  trainer  (ICOFT);  and  (4)  whether 
selected  ability  and  nonability  tests  predict  performance  on  each 
device.  The  specific  objectives  were  to  answer  the  following 
questions : 

1 .  Does  performance  improve  during  TOPGUN  and  VIGS 


training? 

2.  Does  TOPGUN  performance  transfer  to  VIGS  performance,  and 
vice  versa? 

3.  Does  training  performance  on  VIGS  and  TOPGUN  transfer  to 
COFT  performance? 

4.  Which  sequence  of  training  (TOPGUN-VIGS  or  VIGS-TOPGUN ) 
shows  better  transfer  to  ICOFT? 

5.  Do  selected  aptitude,  ability,  motivational,  demographic, 
and  experience  measures  predict  TOPGUN  and  VIGS 
performance? 


METHOD 


Subjects 

Subjects  were  drawn  from  undergraduate  and  graduate  classes 
located  at  the  University  of  Central  Florida  in  Orlando,  Florida, 
on  a  voluntary  basis  in  accordance  with  American  Psychological 
Association  Principles  for  Research  with  Human  Subjects.  An 
effort  was  made  to  solicit  Army  and  Air  Force  ROTC  students.  The 
sign-up  sheet,  which  was  circulated  in  classes  and  fraternities, 
stated  requirements  for  participation  and  informed  applicants  of 
the  nature  of  the  study  and  payment  conditions  (Appendix  E).  All 
subjects  (n  =  60)  were  male;  there  were  17  freshmen,  11 
sophomores,  15  juniors,  13  seniors,  and  three  graduate  students. 
Eighteen  of  the  subjects  were  drawn  from  Army  (8)  and  Air  Force 
(10)  ROTC  units  on  campus,  with  times  in  ROTC  ranging  from  1 
month  to  2  years.  Two-thirds  of  the  subjects  indicated  on  a 
pretest  questionnaire  (Appendix  F)  that  they  played  video  games 
not  at  all  or  less  than  once  per  week.  Subjects  were  screened  for 
participation  by  a  short  test  of  color-blindness.  They  were 
informed  as  to  the  general  nature  of  the  experiment  prior  to 
testing,  completed  informed  consent  forms  (Appendix  G)  prior  to 
participation,  and  were  paid  five  dollars  per  hour  for  their 
participation  in  the  study. 

Materials 


Two  part-task  tank  gunnery  simulators  (TOPGUN  and  VIGS)  and 
one  high-fidelity  simulator  (ICOFT)  were  used.  An  analysis  by 
Hoffman  and  Morrison  (1988)  compared  the  skills  trained  by  TOPGUN 
and  VIG£ .  These  skills  can  be  grouped  into  five  general 
categories:  1 )procedural  training  (manipulating  correct  switches 
in  their  proper  sequence),  2  )target  identification 
(identification  of  particular  types  of  targets),  3)target 
detection,  4)target  tracking  (ability  to  keep  reticle  constantly 
on  the  target  whether  that  target  is  moving  or  not),  and 
5 )marksmanship  training  (accuracy  and  speed  of  target 
engagement).  Drawing  from  that  analysis,  a  further  analysis  was 
made  of  the  particular  tasks  that  are  trainable  on  the  devices, 
in  some  cases  extending  Hoffman  and  Morrison's  analysis  to 
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account  for  changes  which  have  occurred  in  each  devices '6 
configuration,  and  to  include  COFT.  The  resulting  task  analysis 
was  referred  to  earlier  and  is  included  as  Appendix  C. 

TOPGUN.  The  TOPGUN  trainer,  as  described  earlier,  is  a 
prototype  arcade-type  part-task  trainer  for  the  gunner  position. 
The  trainee  engages  single,  multiple,  moving,  and  stationary 
targets  in  response  to  an  automated  "tank  commander's" 
instructions.  The  tank  commander  is  TOPGUN 's  onboard  computer 
which  evaluates  threats,  assigns  them  priority,  and  directs  the 
engagement  accordingly.  TOPGUN  operates  in  one  of  two  modes: 
Recreational  Mode,  designed  for  dayroom  type  activity,  which 
presents  threats  in  a  random  manner;  and  Formal  Mode,  which 
allows  the  experimenter  or  instructor  to  program  specific  threat 
placements  and  kinematics.  For  this  study,  the  formal  mode  was 
used  in  which  a  total  of  36  targets  were  engaged,  using  a 
progressively  more  difficult  mix  of  movements  (stationary  vs. 
moving),  number  of  targets  (single  vs.  multiple),  and  gunner 
sights  (primary,  thermal,  and  secondary).  The  specific  target 
sequence  used  for  TOPGUN  is  provided  in  Appendix  H. 

TOPGUN  gives  numerous  performance  measures,  including  the 
various  speed  and  accuracy  measures  used  in  this  experiment:  time 
to  fire,  time  to  kill,  azimuth  and  elevation  errors  from  target 
center  of  mass,  hit  percentage,  and  a  composite  performance  score 
which  gives  100  points  for  each  first  round  hit,  50  points  for 
each  second  round  hit,  and  0  for  poorer  performance.  Time  to 
fire,  time  to  kill,  and  aiming  errors  were  based  on  first  round 
data.  Hit  percentage  was  calculated  as  the  number  of  first  rounds 
hitting  the  target  divided  by  the  number  of  first  rounds  fired, 
and  does  not  account  for  engagements  for  which  no  rounds  were 
fired.  This  measure  is  not  equivalent  to  hit  percentage  used  by 
Witmer  (1988),  who  defined  first-round  hit  percentage  as  the 
total  number  of  first-round  hits  divided  by  the  number  of 
engagements  presented  and  total  hit  percentage  as  the  total 
number  of  hits  divided  by  the  number  of  engagements.  The 
composite  performance  score,  on  the  other  hand,  included  second 
round  data. 

VIGS .  The  Ml  Videodisk  Gunnery  Simulator  (VIGS)  is  also 
designed  to  act  as  a  part-task  trainer  for  Ml  or  M1A1  tank 
gunners.  The  VIGS  trainer  utilizes  computer  generated  imagery 
(CGI)  to  present  engagement  scenes  to  the  trainee.  These  scenes, 
along  with  target  identification  slides,  are  presented,  modified, 
and  stored  via  videodisk  technology.  In  this  way  battle 
"missions"  are  created  as  collections  of  previously  stored 
individual  "lessons".  The  lessons,  stored  on  videodisk,  each 
present  an  engagement  of  approximately  45  seconds'  duration. 
Through  the  use  of  synthesized  speech,  the  "tank  commander" 
informs  the  trainee  of  the  target  type,  required  ammunition,  and 
fire  directives.  At  the  end  of  the  engagement,  trainees  are 
provided  detailed  performance  measures. 


VIGS  provides  the  same  performance  measures  as  TOPGUN  with 
the  exception  that  the  composite  performance  score  is  calculated 
differently.  For  each  mission,  if  the  trainee  fired  accurately  in 
the  optimal  time,  he  was  given  100  points;  point  penalties  were 
assessed  for  too  many  main  gun  fires  (-5),  wrong  ammunition 
indexed  (-30),  fired  at  wrong  target  first  (-5),  ambushed  the 
target  (-5),  fired  before  the  "fire"  command  (-10),  used  the 
wrong  GAS  reticle  (-30),  or  failed  to  lase  (-5).  If  he  took 
longer  to  fire  than  the  optimal  time,  points  were  deducted  as  the 
difference  fiom  optimal  time  increased.  A  total  of  41  targets 
were  presented  using  a  progressively  more  difficult  mix  of 
movements  (stationary  vs.  moving),  number  of  targets  (single  vs. 
multiple),  and  gunner  sights  (primary,  thermal,  and  secondary). 
See  Appendix  H  for  the  specific  target  sequence. 

UCOFT.  The  Ml  UCOFT  (Unit  Conduct-of-Fire  Trainer)  is  a 
high-fidelity  gunnery  trainer  that  presents  computer-  generated 
target  imagery  for  training  in  normal  and  degraded  operational 
modes.  Training  is  directed  by  an  Instructional  Subsystem  which 
includes  a  library  of  preprogrammed  exercises  and  an  adaptive 
Evaluation  System  (UCOFT  Utilization  Handbook,  1985).  For  this 
study,  six  exercises  of  10  engagements  each  were  used  to  match  as 
closely  as  possible  target  conditions  used  in  the  TOPGUN  and  VIGS 
trainers  (Appendix  H).  Also,  in  this  study,  the  Institutional 
form  of  UCOFT  (ICOFT)  was  used  because  the  ICOFT  uses  a 
standardized,  synthetic  tank  commander  in  contrast  to  the  UCOFT 
where  real  tank  commander  performance  is  free  to  vary  and  thus 
may  contribute  to  unreliability  of  measurement. 

Hoffman  and  Witmer  (1989)  discuss  the  conflicting  merits  of 
various  UCOFT  scoring  systems.  Selection  and  scoring  of  these 
indicators  have  in  the  past  been  tailored  to  specific  research 
questions  (e.g.,  Abel,  1987;  Black  &  Abel,  1987;  DuBois,  1987; 
Graham,  1986;  Smith  &  Graham,  1987;  Witmer,  1987).  We  chose  a 
combination  of  single  scores  and  composite  scores  to  determine 
which  vere  more  reliable  across  exercises.  The  performance 
measures  used  in  this  study  were  time  to  fire,  time  to  kill, 
number  of  rounds,  and  number  of  hits  (from  which  hit  percentage 
was  subsequently  calculated),  and  two  composite  measures,  number 
of  target  acquisition  errors,  and  reticle  aim  score.  The 
composite  Target  Acquisition  (TA)  score  is  based  on  the  time  to 
acquire  targets  and  number  of  target  identification  and 
classification  errors.  Reticle  Aim  (RA)  is  a  composite  function 
of  time  to  fire  the  first  round,  time  to  kill,  and  magnitude  of 
the  aiming  error.  A  composite  gunnery  index,  advocated  by  Witmer 
(1988),  has  been  evaluated  by  Bliss  (1989,  in  preparation). 

Graham  (1986)  showed  that  gunnery  performance  of 
inexperienced  gunners  could  be  reliably  measured  on  the  UCOFT 
using  31  engagements  in  different  sequences.  Retest  reliability 
of  six  of  nine  gunnery  performance  measures  exceeded  .70,  ranging 
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from  .72  to  .87.  However,  retest  measures  were  only  separated  by 
a  10-minute  rest  period  instead  of  the  more  common  method  of 
retesting  on  separate  days. 

APTS .  The  Automated  Performance  Test  System  (APTS)  includes 
a  battery  of  seven  performance  tests.  The  tests  have  been  shown 
to  be  stable  (<10  minutes  testing  time),  reliable  (r  >  .707),  and 
of  known  and  unique  factorial  content  (e.g.,  Turnage,  Kennedy,  & 
Osteen,  1987).  The  APTS  test  battery  is  delivered  on  the  Zenith 
Data  Systems  ZFL-181  portable  microcomputer.  The  ZFL-181  contains 
640K  on  board  memory,  two  720K  3.5  inch  floppy  drives,  serial  and 
parallel  ports,  an  RGB  interface,  and  80  characters  by  25  line 
supertwist,  backlit  LCD  display,  and  is  completely  IBM  PC 
compatible.  The  batteries  are  capable  of  powering  the  unit  for 
4.2  hours.  Eighteen  response  measures  are  obtainable  from  the 
APTS,  and  subjects  are  required  to  press  keys  on  the  keyboard  to 
provide  answers  and  responses.  The  following  APTS  subtests  used 
in  this  study  are  lisced  in  their  order  of  presentation: 

Tapping  (NPTAP;  TFTAP ) .  The  tapping  test  is  a  motor  skills 
performance  test  which  has  been  highly  recommended  for  inclusion 
in  microbased  repeated-measures  batteries  (Kennedy,  Wilkes, 
Dunlap,  &  Lane,  1985).  The  subject  is  required  to  press  the  S  and 
D  keys  alternately  as  fast  as  possible.  Scoring  is  based  upon  the 
number  of  alternate  keypresses  recorded,  as  this  insures  that  the 
subject  is  pressing  more  than  one  key.  Subjects  are  instructed  to 
perform  some  trials  using  their  "non-preferred"  hand  (NPTAP)  and 
some  trials  alternating  taps  between  the  index  fingers  of  each 
hand  (two-finger  tap  TFTAT ) . 

Four-Choice  Reaction  Time  ( RT ) .  The  Four-Choice  Visual 
Reaction  Time  test  (Donders,  1968)  involves  the  presentation  of  a 
visual  stimulus  and  measurement  of  a  response  latency  to  the 
stimulus.  The  subject  is  instructed  to  respond  as  quickly  as 
possible  with  a  key  press  to  a  simple  visual  stimulus.  The  visual 
stimulus  is  preceded  by  an  auditory  signal  and  no  decision  making 
(disjunctive)  regarding  the  stimuli  is  necessary.  Reaction  time 
is  measured  in  milliseconds  from  the  onset  of  the  visual  stimulus 
to  the  key  press.  The  participant  observes  boxes  on  the  screen 
until  one  changes  appearance  (from  an  "outlined"  to  a  "filled" 
pattern).  Then  he  presses  the  corresponding  key.  This  test  is 
described  as  of  a  perceptual  nature. 

Code  Substitution  (CS).  The  Code  Substitution  Test 
(Ekstrom,  French,  Harmon,  &  Derman,  1976)  is  derived  by  randomly 
assigning  digits  to  nine  letters.  The  subject's  task  is  to  repeat 
the  assigned  digit  code  when  presented  with  the  test  letters. 
There  is  no  response  deadline,  and  each  coding  string  remains  on 
the  screen  for  30  trials.  Code  Substitution  is  described  as  a 
cognitive  and  perceptual-type  task  with  visual  search  encoding 
and  decoding,  rote  recall,  and  perceptual  speed  as  important 
factors  in  performance.  Previous  studies  of  Code  Substitution 
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(Pepper,  Kennedy,  Bittner,  Wiker,  &  Harbeson,  1985)  have 
indicated  that  the  task  is  acceptable  for  use  in  repeated- 
measures  research.  Response  time  is  recorded  in  milliseconds  from 
the  appearance  of  the  probe  letter  until  a  response  is  made. 

Grammatical  Reasoning  (GR).  The  Grammatical  Reasoning  test 
(Baddeley,  1968)  involves  five  grammatical  transformations  on 
statements  about  the  relationship  between  two  letters,  A  and  B. 
The  five  transformations  included  are:  1 )  active  versus  passive 
construction,  2)  true  versus  false  statements,  3)  affirmative 
versus  negative  phrasing,  4)  use  of  the  verb  "precedes"  versus 
the  verb  "follows,"  and  5)  A  versus  B  mentioned  first.  There  are 
32  possible  items  arranged  in  random  order.  The  subject's  task  is 
to  respond  "True"  or  "False",  depending  on  the  presentation  of 
the  statement.  Performance  is  scored  according  to  the  number  of 
transformations  correctly  identified.  Grammatical  Reasoning  is 
described  as  measuring  higher  mental  processes  with  reasoning, 
logic,  and  verbal  ability  as  important  factors  in  test 
performance.  Previous  studies  with  Grammatical  Reasoning 
identified  in  Bittner,  Carter,  Kennedy,  Harbeson,  and  Krause 
(1986)  have  indicated  that  the  task  is  acceptable  for  use  in 
repeated-measures  research. 

Simultaneous  Pattern  Comparison  (PC).  The  Pattern 
Comparison  Test  (Klein  &  Armitage,  1979),  which  measures  factors 
relating  to  target  acquisition  and  visual  search,  requires  the 
subject  to  examine  a  pair  of  eight-dot  patterns  and  to  determine 
whether  they  are  "same"  or  "different".  Patterns  are  randomly 
generated  with  similar  and  different  pairs  simultaneously 
presented  in  random  order.  Performance  is  scored  according  to  the 
number  of  pairs  correctly  identified  as  similar  or  different. 
Pattern  Comparison  is  described  as  a  spatial  ability  important  to 
perceptual  performance.  Response  time  is  recorded  in  milliseconds 
measured  from  the  appearance  of  the  two  patterns  until  a  response 
is  made.  A  review  of  Pattern  Comparison  studies  (Bittner  et  al., 
1986)  indicated  that  the  test  is  acceptable  for  use  in  repeated- 
measures  research. 

Manikin  (MK).  The  Manikin  test  (Benson  &  Gedye,  1963) 
involves  the  presentation  of  a  simulated  human  figure  in  either  a 
full-front  or  full-back  facing  position.  The  figure  is  shown  to 
have  two  easily  differentiated  hand-held  patterns.  One  of  the  two 
patterns  is  the  matched  pair  to  a  pattern  appearing  below  the 
figure.  The  subject's  task  is  to  determine  which  hand  of  the 
figure  holds  a  matching  pattern  and  respond  by  pressing  the 
appropriate  arrow  key  (right  arrow  for  right;  left  arrow  for 
left).  Pattern  type,  hand  associated  with  the  matching  pattern, 
and  f ront-to-back  figure  orientation  are  randomly  determined  for 
each  trial.  Bittner  et  al.  (1986)  recommended  the  use  of  the 
Manikin  Test  when  latency  scores  are  reported  (in  milliseconds 
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from  the  time  the  stimulus  appears  until  a  response  is  made. 
Performance  is  also  based  on  the  number  of  correctly  matched 
pairs.  The  Manikin  test  is  a  perceptual  measure  of  spatial 
transformation  of  mental  images  and  involves  spatial  ability. 

Mathematical  Processing  (MP).  Mathematical  Processing 
requires  the  subject  to  perform  arithmetical  operations  as  well 
as  value  comparison  of  numeric  stimuli.  The  subject  performs  one 
to  three  addition  and/or  subtraction  operations  in  a  single 
presentation.  A  response  is  then  made  which  indicates  whether  the 
total  is  greater  or  less  than  a  prespecified  value  using  the 
arrow  keys.  Number  of  correct  responses  and  response  latencies 
are  recorded. 

All  tests  were  presented  for  120  seconds,  except  for  Four- 
Choice  Reaction  Time,  which  was  presented  for  90  seconds  and  both 
Tapping  tests,  which  were  presented  for  20  seconds. 

The  stability  and  reliability  of  the  APTS  subtests  have  been 
demonstrated  (Kennedy,  Wilkes,  Dunlap,  &  Kuntz,  1987;  Turnage, 
Kennedy,  &  Osteen,  1987).  In  Kennedy  et  al.'s  (1987)  study,  none 
of  the  APTS  subtests'  task  definition  reliabilities  (average 
reliability  of  a  task  following  the  occurrence  of  correlational 
stability)  were  observed  to  fall  below  r  =  .71,  and  their 
three-minute  reliabilities  (reliabilities  of  stabilized  tasks 
standardized  to  a  three-minute  administration  base)  were  even 
higher  (r  >  .79).  Other  examples  of  the  APTS’  reliability  and 
stability  are  available  as  well  (Kennedy,  Wilkes,  Lane,  &  Homick, 
1985;  Turnage,  Kennedy,  Gilson,  Bliss,  &  Nolan,  1988) 

WOFO.  The  Work  and  Family  Orientation  Questionnaire  (WOFO, 
Helmreich  &  Spence,  1978)  is  a  thirty-two  item  measure  of 
achievement  motivation  and  attitudes  toward  family  and  career. 

The  twenty-three  motivational  items  used  in  this  study  form  four 
scales  designated  Work,  Mastery,  Competitiveness,  and  Personal 
Unconcern.  "The  first  three  deal  respectively  with  desire  to  work 
hard,  desire  for  intellectual  challenge,  and  desire  to  succeed  in 
competitive,  interpersonal  situations.  Personal  unconcern 
measures  attitudes  about  the  possible  negative  consequences  of 
achievement  and  is  conceptually  related  to  the  notion  of  Fear  of 
Success"  (p.  35).  These  factors  have  shown  considerable  validity 
in  predicting  criteria  such  as  college  grades,  scientific 
attainment,  income,  entrepreneurial  success,  and  pilot 
performance  (Carsrud,  Olm,  &  Thomas,  1984;  Helmreich,  1982; 
Helmreich,  Spence,  Beane,  Lucker,  &  Spence,  1980;  Spence  & 
Helmreich,  1983).  ReliaDilities  expressed  as  Alpha  coefficients 
range  from  .50  on  personal  unconcern  to  .76  and  .72  for 
competitiveness  in  males  and  females  respectively  (Helmreich  & 
Spence,  1978). 

VISTECH.  The  VISTECH  6500  ( VCTS  6500),  a  test  of  contrast 
sensitivity,  employs  three  full-sized  eye  charts  which  yield  five 
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spatial  frequency  scores  (1.5,  3,  6,  12,  and  18  cycles  per  degree 
of  visual  angle).  The  subject  views  3"  diameter  target  gratings 
(alternating  light  and  dark  stripes)  from  10  feet  with  both  eyes. 
There  is  monotonic  gradation  in  contrast  change  from  1  to  9  for 
each  of  the  spatial  frequencies  gratings.  The  subject's 
performance  is  the  total  number  correct  at  each  frequency  and 
this  value  is  converted  via  scaled  scores  which  correspond  to 
threshold  sensitivity  values  for  each  frequency.  Contrast 
Sensitivity  Test  (CST)  measures  were  selected  because  they  have 
been  shown  to  correlate  with  various  external  criteria  of  target 
acquisition  (Ginsburg,  Easterly,  &  Evans,  1983;  Shinear  &  Gilead, 
1987;  Kennedy,  Berbaum,  Collyer,  May  &  Dunlap,  1988). 

ASVAB .  A  synthetic  version  (Barron's  Educational  Series, 
1986)  of  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) 
was  used  to  measure  five  areas  considered  to  be  predictive  of 
tank  gunnery  performance:  1)  General  Science,  2)  Coding  Speed,  3) 
Automotive  and  Shop  Information,  4)  Mechanical  Comprehension,  and 
5)  Electronics  Information.  All  ten  tests  from  the  full-scale 
ASVAB  were  not  used  because  of  time  constraints  in  administering 
the  full  2.5  hour  test. 

Table  1  provides  a  summary  of  all  the  predictor  tests,  their 
abbreviations,  and  a  short  description  of  the  constructs  measured 
by  the  test. 
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Table  1 


Summary  of  Predictor  Test  Abbreviations  and  Constructs  Measured 


ASVAB  (Armed  Services  Vocational  Aptitude  Battery) 

1  -  GENERAL  SCIENCE  -  Knowledge  of  elementary  scientific 

principles . 

2  -  CODING  SPEED  -  Ability  to  match  key  digit  string  to  correct 

alternative. 

3  -  AUTO  &  SHOP  INFO  -  Knowledge  of  automobile  and  shop 

mechanics. 

4  -  MECHANICAL  COMPREHENSION  -  Knowledge  of  general  mechanical 

and  physical  principles. 

5  -  ELECTRONICS  INFORMATION  -  Knowledge  of  electrical  and  radio 

principles . 

WOFO  (Work  and  Family  Orientation  Questionnaire) 

1  -  MASTERY  -  Degree  to  which  person  values  task  mastery. 

2  -  COMPETITIVENESS  -  Degree  to  which  a  person  is  competitive. 

3  -  WORK  -  Degree  to  which  person  values  his/her  work. 

4  -  PERSONAL  UNCONCERN  -  Degree  to  which  personal  relations 

interact  with  task  goals. 

APTS  (Automated  Performance  Test  System) 

TAPPING  (NPTAP)  -  Measures  manual  dexterity  (non-preferred 

hand ) . 

4-CHOICE  REACTION  TIME  ( RTARL )  -  Measure  of  reaction  time. 

CODE  SUBSTITUTION  (CSNC)  -  Ability  to  use  rules  to  decode. 

GRAMMATICAL  REASONING  ( GRNC )  -  Measures  verbal  and 

grammatical  ability. 

MANIKIN  ( MKNC )  -  Measure  of  spatial  relations. 

PATTERN  COMPARISON  ( PCNC )  -  Measure  of  spatial  relations. 
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Table  1  (Cont.) 

MATH  PROCESSING  (MPNC)  -  Measures  ability  to  quickly  perform 

elementary  mathematical  operations. 

TAPPING  (TFTAP)  -  Measures  manual  dexterity  (two  hands). 

VISTECH  -  Contrast  sensitivity  vision  test,  measuring  acuity. 

FREQ.  1  -  1.5  Cycles  per  degree  spatial  frequency. 

FREQ.  2-3.0  Cycles  per  degree  spatial  frequency. 

FREQ.  3  -  6.0  Cycles  per  degree  spatial  frequency. 

FREQ.  4  -  12.0  Cycles  per  degree  spatial  frequency. 

FREQ.  5  -  18-0  Cycles  per  degree  spatial  frequency. 

ISHIHARA  -  Colorblindness  test,  measuring  ability  to  detect 
colors . 
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Procedure 


As  shown  in  Table  2,  each  training  group,  composed  of  20 
randomly  assigned  subjects,  reported  for  approximately  four  hours 
of  pretesting  (Phase  One),  eight  hours  of  training  and  transfer 
(Phases  Two  and  Three),  and  two  hours  of  ICOFT  testing.  Control 
subjects'  procedures  were  the  same,  except  no  VIGS  or  TOPGUN 
training  was  given. 

Table  2 

Sequence  of  Orientation,  Training,  and  Transfer  for  TOPGUN-first 
and  VIGS-first  Groups. 

Phase  1  Phase  2  Phase  3  Phase  4 


Group 

( Pretest ) 

(Training ) 

( Transfer ) 

(ICOFT) 

TOPGUN 

First 

ASVAB,  APTS, 
WOFO 

TOPGUN  training 
(4X27  engagements) 

VIGS  training 
(4X27  engagements) 

ICOFT 

VIGS 

First 

ASVAB,  APTS, 
WOFO 

VIGS  training 
(4X27  engagements) 

TOPGUN  training 
(4X27  engagements) 

ICOFT 

CONTROL 

ASVAB,  APTS, 
WOFO 

ICOFT 

Time  4  Hours  2  Hrs/2  Hrs  2  Hrs/2  Hrs  4  Hours 


During  the  first  week  (Phase  1)  of  each  subject's  three  week 
experimentation  period,  subjects  reported  to  the  Institute  for 
Simulation  and  Training  in  order  to  complete  the  battery  of 
predictor  tests  that  were  previously  described,  plus  the  Ishihara 
color  blind  plates,  which  provided  a  screener  for  color¬ 
blindness.  They  were  given  standardized  instructions  and 
administrative  procedures,  as  described  in  Appendix  I.  Testing 
took  approximately  four  hours.  The  order  of  tests  was  as  follows: 
1)  Ishihara  colorblind  test,  2)  VISTECH  contrast  sensitivity 
test,  3)  APTS  (first  replication),  4)  ASVAB ,  5)  APTS  (second 
replication),  6)  Work  and  Family  Orientation  Questionnaire 
( WOFO ) ,  7)  APTS  (third  replication),  and  8)  VISTECH  (second 
replication).  Third  and  fourth  VISTECH  administrations  took  place 
in  subsequent  sessions. 

In  Phase  2,  twenty  subjects  were  randomly  assigned  to  either 
one  of  the  experimental  groups,  TOPGUN-first  or  VIGS-first,  or  to 
the  control  group,  which  received  only  ICOFT  training.  TOPGUN  and 
VICS  subjects  completed  familiarization  and  two  trials  of 
training  on  the  first  day  of  training.  Familiarization  on  both 
TOPGUN  and  VIGS  included  general  information  about  the  device. 
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instructions  concerning  how  to  manipulate  the  gunnery  control 
handles  and  switches,  and  a  short  scenario  (six  engagements, 
representative  of  each  type  of  target  to  be  encountered). 
Instructions  for  TOPGUN,  VIGS,  and  GAS  sighting,  common  to  both 
devices,  are  included  in  Appendix  J,  Appendix  K,  and  Appendix  L, 
respectively.  The  next  day,  the  same  subject  completed  two  more 
trials  of  training  on  the  same  device,  followed  by  two  days 
training  on  the  alternate  device. 

TOPGUN  training  consisted  of  two  36-target  trials  per  day, 
each  of  which  took  approximately  20  minutes  to  complete.  Table  3 
lists  a  summary  of  the  sequence  of  engagements  presented, 
representing  a  cross-section  of  battle  conditions  and  device 
settings,  including  Gunner's  Primary  Sight  and  Auxiliary  Sight 
(GPS  and  GAS)  engagements,  as  well  as  Thermal  Infrared  Sighting 
(TIS)  engagements.  Target  arrays  were  arranged  as  indicated  in 
Table  3  so  that,  within  each  sight  mode,  stationary,  single 
targets  appeared  first;  followed  by  moving,  single  targets;  and, 
finally,  multiple  target  sets.  At  the  same  time,  GPS  and  TIS 
engagements  were  presented  first  (since  gunnery  behaviors  were 
not  expected  to  vary  significantly  between  these  two  sight 
modes),  followed  by  more  difficult  GAS  engagements.  Therefore, 
the  total  number  of  TOPGUN  engagements  presented  over  the  two-day 
period  was  144. 

VIGS  training  consisted  of  two  41 -target,  trials  per  day, 
each  of  which  took  approximately  50  minutes  to  complete.  VIGS 
engagements  also  presented  a  cross-section  of  battle  conditions 
and  device  settings  (see  Table  3).  Target  category  sequence  was 
identical  to  that  of  TOPGUN;  however,  due  to  incompatibility  of 
scenario  selection  and  generation  across  devices,  the  number  of 
engagements  per  target  category  for  VIGS  was  not  exactly  the  same 
as  for  TOPGUN.  The  total  number  of  VIGS  engagements  presented 
over  the  two-day  period  was  164. 

For  both  TOPGUN  and  VIGS  training,  immediate  performance 
feedback  was  given  by  the  respective  automated  performance 
measurement  systems.  For  example,  TOPGUN  gave  subjects 
information  on  length  of  engagement,  number  of  rounds  fired, 
average  rounds  per  kill,  total  number  of  kills,  and  a  cumulative 
performance  score  over  engagements.  For  VIGS,  information 
contained  time  to  kill,  total  trial  score,  trial  performance 
score  and  rating  (distinguished,  superior,  qualified,  or 
unqualified),  total  rounds  fired,  and  elevation  and  azimuth 
errors  per  round.  In  addition,  subjects  were  given  a  narrative 
critique  of  errors  for  each  trial.  In  addition,  the  experimenters 
corrected  performance  during  trials  as  necessary,  and  gave  verbal 
instruction  and  feedback  following  trials  to  promote  learning. 

For  example,  if  the  subject  consistently  forgot  to  lase,  they 
were  reminded  to  depress  the  lase  button  before  firing. 
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Table  3 


List  of  Engagement  Sequences  Per  Device 

TOPGUN  VIGS 


*  Five  stationary,  single 
targets 

(3  GPS,  2  TIS) 

*  Five  moving,  single  targets 
targets 

(2  GPS,  3  TIS) 

*  Five  multiple  target  sets 
(stationary  targets; 

3  GPS,  2  TIS) 

*  Four  stationary,  single 
targets  (GAS) 

*  Four  moving,  single  targets 


*  Four  multiple  target 

(moving  or  stat.)  sets  (GAS) 


*  Six  stationary,  single 
targets 

(5  GPS,  1  TIS) 

*  Three  moving,  single 
targets 

( 1  GPS,  two  TIS) 

*  Nine  multiple  target 
sets  (moving  and  station¬ 
ary  mix;  5  GPS,  4  TIS) 

*  One  stationary,  single 
target  (GAS) 

*  Three  moving,  single  (GAS) 
targets  (GAS) 

*  Three  multiple  target 
(moving  or  stat.)  sets  (GAS) 


Note.  A  multiple  target  set  consists  of  two  targets  presented 
simultaneously . 


In  Phase  3,  all  subjects  were  transported  to  the  GE 
facilities  in  Daytona  Beach,  Florida,  for  approximately  2.5  hours 
of  familiarization  and  testing  per  subject  on  the  ICOFT.  Three 
trained  instructor/operators  (I/Os)  delivered  the  training  using 
the  testing  procedures  described  in  Hoffman  and  Witmer  (1989). 
After  familiarization,  subjects  were  required  to  perform  the 
engagements  (10  per  exercise)  on  ICOFT  exercises  312110,  313110, 
322610,  323210,  332110,  and  333110,  delivered  in  standard  order. 
These  engagements  were  selected  to  match  as  closely  as  possible 
the  engagement  sequences  used  on  TOPGUN  and  VIGS  trainers.  Also, 
to  approximate  as  closely  as  possible  the  engagement  sequences 
used  on  TOPGUN  and  VIGS  trainers,  COAX  engagements  (a  total  of 
four)  were  deleted  from  analyses.  Immediately  upon  returning  from 
ICOFT  testing,  subjects  were  given  an  opinion  questionnaire  which 
asked  questions  about  both  TOPGUN  and  VIGS  trainers  (Appendix  M). 

Performance  Measures 

When  attempting  to  measure  gunnery  performance,  one  may 
choose  from  a  number  of  possible  indices  (i.e.,  time  to  fire, 
time  to  identify  the  target,  time  to  kill,  round  flight  time, 
total  time  of  engagement,  and  various  derived  accuracy  errors,  to 
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name  a  few).  The  performance  measure;  used  in  this  study  for  VIGS 
and  TOPGUN  were  azimuth  and  elevation  aiming  error  (in  mils), 
time  to  fire  (time  from  presentation  of  the  target  to  firing  the 
first  round),  and  time  to  kill.  Due  to  demonstrated  low 
reliability  of  azimuth  and  elevation  errors  (Witmer,  1987),  hit 
percentage  was  also  ur>d  as  a  measure  of  firing  accuracy.  Hit 
percentage  was  calculated  by  dividing  the  number  of  first  rounds 
hitting  the  target  by  the  total  number  of  first  rounds  fired. 
Finally,  composite  performance  scores,  which  are  part  of  the 
computerized  records  output  from  each  device,  were  used.  For 
ICOFT,  time  to  fire,  time  to  kill,  hit  percentage,  target 
acquisition  (TA)  error,  and  reticle  aim  (RA)  scores,  all  part  of 
the  session  performance  summary  output,  were  used. 

RESULTS 

First,  to  prepare  adequately  the  data  obtained,  a  complete 
screening  and  inspection  of  the  individual  scores  for  each 
predictor  test  and  simulator  performance  was  completed  in  order 
to  detect  anomalies  in  the  data,  such  as  missing  data  points  (due 
to  equipment  malfunction,  subject  attrition,  and  data  recording 
error,  for  example)  and  "outliers".  Based  on  glitches  and/or 
unreliable  data,  engagements  2,  22,  and  26  were  dropped  from 
TOPGUN  analyses  and  engagements  22,  23,  24,  and  25  were  deleted 
from  VIGS  analyses.  For  TOPGUN,  engagement  2  involved  a 
stationary  single  target  engaged  using  the  primary  sight, 
engagement  22  was  a  stationary  single  target  engaged  using  the 
secondary  sight,  and  engagement  26  was  a  moving  single  target 
engaged  using  the  secondary  sight.  For  VIGS,  engagements  22  and 
23  involved  multiple  targets  (moving  and  stationary  mix)  engaged 
using  the  primary  sight,  and  engagements  24  and  25  were  also 
multiple  targets  engaged  with  thermal  sights. 

Only  first  round  data  were  used  for  all  subsequent  analyses 
except  for  derived  scores  (e.g.,  VIGS  and  TOPGUN  performance 
scores,  and  ICOFT  TA  error  and  RA  grade)  which  may  also  include 
second  round  data,  because  second  round  data  were  incomplete  and 
sporadic.  For  example,  some  engagements  had  no  second  round,  due 
to  the  gunner's  first  round  hit.  This  mada  analysis  of  second 
round  data  difficult  because  analysis  requires  separation  of  time 
to  fire  and  time  to  kill  into  first  round  and  second  round 
figures.  There  were  many  extraneous  effects  that  could  occur 
between  round  one  and  round  two,  such  as  the  obscuration  of  a 
target  by  a  tree  or  the  changing  of  direction  by  a  moving  target, 
making  the  reliability  of  round  two  data  extremely  dubious.  In 
addition,  round  two  data  can  be  considered  unrepresentative  in 
that  they  are  usually  present  only  for  more  difficult  targets 
(i.e.,  when  there  was  no  first  round  hit).  The  scoring 
difficulties  for  round  two  data  were  further  complicated  when  the 
second  round  contained  multiple  targets.  Further  advances  in  each 
device's  performance  measurement  system  output,  as  well  as 
additional  research  will  be  necessary  to  disentangle  the  problems 
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of  second  round  data  analysis. 

Group  means  and  standard  deviations  were  calculated  for  each 
individual  test  and  response  measure  from  all  repeated  measures 
(the  APTS  series,  VISTECH  charts,  and  TOPGUN  and  VIGS  simulation 
scores)  to  determine  the  extent  of  stabilization  (Jones,  1980; 
Jones,  Kennedy,  &  Bittner,  1981)  and  the  slope  of  learning 
curves . 

Trial  Effects  on  VIGS  and  TOPGUN 

Tables  4  and  5  present  the  means  and  standard  deviations  for 
each  of  the  TOPGUN  and  VIGS  criterion  measures  bytrial  for  the 
TOPGUN-first  and  VIGS-first  groups,  respectively.  It  should  be 
noted  that  scores  for  some  measures  differ  across  devices, 
particularly  the  time  to  fire  and  time  to  kill  scores,  which  are 
considerably  longer  for  VIGS;  the  azimuth  error  scores,  which  are 
greater  for  VIGS;  and  composite  performance  scores  which  are 
comparatively  lower  on  VIGS.  Azimuth  and  elevation  error  scores, 
while  recorded  as  "round  point-of-impact "  on  VIGS,  were  recorded 
as  "reticle  aim"  figures  on  TOPGUN,  further  contributing  to 
differences.  Composite  performance  scores  were  also  calculated 
differently  for  VIGS  and  TOPGUN.  Figures  illustrating  how  the 
means  change  for  each  group  across  trials  are  located  in  Appendix 
N.  For  both  groups,  skill  acquisition  proceeded  at  fairly  slow 
but  consistent  rates  with  the  largest  improvements  in  scores 
occurring  between  Trials  1  and  2,  as  would  be  expected.  At  Trial 
4  generally  means  were  continuing  to  improve  and  deviations  were 
continuing  to  decrease,  indicating  that  performances  had  not  yet 
stabilized.  In  general,  more  learning  was  demonstrated  within 
days  than  across  days. 
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Table  4 


Criterion  Means  and  Standard  Deviations  by  Trial  and  Device  for 
TOPGUN-First  Group 


Measure 

1 

TOPGUN  Trials 

2  3  4 

1 

VIGS 

2 

Trials 

3  4 

Time  to  Fire 

(M) 

5.00 

3.98 

3.93 

3.74 

10.3 

10.1 

9.98 

9.78 

(SD) 

1.12 

.786 

.773 

.853 

.896 

.814 

.552 

.493 

Time  to  Kill 

(M) 

5.89 

4.93 

4.86 

4.68 

11.2 

1  1  . 0 

10.8 

10.6 

(SD) 

1.11 

.789 

.  772 

.869 

.895 

.91  1 

.601 

.479 

Elev.  Error 

(M) 

.495 

.480 

.  461 

.448 

.444 

.402 

.417 

.  364 

(SD) 

.089 

.057 

.054 

.062 

.099 

.071 

.053 

.055 

Az .  Error 

(M) 

.456 

.419 

.422 

.410 

1  .02 

.935 

.871 

.880 

(SD) 

.278 

.  1  28 

.126 

.  1  05 

.337 

.330 

.  170 

.216 

Hit  Percent. 

(M  ) 

76.5 

86.3 

86.5 

88.6 

70.1 

76.3 

79.0 

79.0 

(SD) 

11.8 

6.91 

5.24 

5.09 

7.61 

7.78 

8.58 

8.12 

Perf.  Score 

(M) 

2594 

2935 

2950 

3015 

1833 

2043 

2147 

2237 

(SD) 

368 

1  94 

173 

185 

250 

224 

1  93 

170 
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Table  5 


Criterion  Means  and  Standard  Deviations  by  Trial  and  Device  for 
VIGS-First  Group 


Measure 

1 

VIGS 

2 

Trials 

3  4 

1 

TOPGUN  Trials 

2  3  4 

Time  to  Fire 

(M) 

11.4 

10.4 

10.3 

9.82 

4.20 

3.70 

3.60 

3.41 

(SD) 

1.18 

.703 

.578 

.447 

.567 

.483 

.499 

.416 

Time  to  Kill 

(M) 

12.2 

11.3 

11.2 

10.7 

5.13 

4.63 

4.53 

4.34 

(SD) 

1.17 

.692 

.542 

.443 

.560 

.487 

.499 

.420 

Elev.  Error 

(M  ) 

.432 

.391 

.416 

.356 

.453 

.476 

.464 

.454 

(SD) 

.049 

.114 

.108 

.050 

.053 

.037 

.053 

.054 

Az.  Error 

(M) 

.949 

.907 

.918 

.842 

.378 

.377 

.350 

.348 

(SD) 

.205 

.252 

.241 

.252 

.  129 

.086 

.  1  07 

.  090 

Hit  Percent- 

(M) 

64.0 

71.2 

74.4 

77.9 

84.0 

89.3 

88.6 

90.9 

(SD) 

8.27 

5.90 

8.43 

8.37 

8.04 

7.25 

5.88 

6.13 

Perf.  Score 

(M) 

1  686 

1958 

2029 

2147 

2860 

3037 

3035 

3087 

(SD) 

232 

148 

197 

173 

277 

215 

1  60 

1  86 
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The  means  and  standard  deviations  across  the  six  exercises 
for  ICOFT  measures  for  the  total  group  were  as  follows:  time  to 
fire  (M  *  16.66,  SD  «  1.32),  time  to  kill  (M  -  17.79,  SD  -  1.51), 
TA  error  (M  «  2.49,  SD  =  1.88),  RA  grade  (M  =  2.11,  SD  =  37), 

and  hit  percentage  (M  =  75.10,  SD  *  12.26). 

Stability  and  Reliability  of  VIGS,  TOPGUN.  and  ICOFT 

Because  demonstration  of  transfer  of  training  between 
devices  requires  reliable  performance  measures,  reliabilities  for 
TOPGUN  and  VIGS  criterion  measures  were  estimated  by  calculating 
the  average  intertrial  correlation  across  the  four  trials  for 
each  device  (i.e.,  by  averaging  all  coefficients  in  the 
correlation  matrix  across  four  trials). 

Table  6  presents  TOPGUN  and  VIGS  intertrial  correlations 
(i.e.,  retest  reliabilities)  and  estimated  reliabilities  (i.e., 
the  average  correlation  from  the  complete  trial-by-trial  matrix) 
for  both  groups.  The  estimated  reliability  is  thus  "estimated" 
not  only  from  correlations  of  adjacent  trials  but  from 
correlations  between  all  possible  trials  to  give  a  more 
conservative  value.  Inspection  of  Table  6  indicates  that  VIGS 
performances  were  consistently  less  stable  and  reliable  across 
trials  for  all  six  criterion  measures,  especially  when 
performances  were  compared  between  Days  1  and  2  (Trials  2  and  3). 
This  inconsistency  in  VIGS  performance  between  Days  1  and  2  may 
be  due  to  differential  forgetting  of  certain  engagement  or  device 
characteristics  among  the  subjects  in  the  course  of  the  time  away 
from  the  device.  It  could  also  be  due  to  the  greater  necessity  to 
accommodate  to  the  physical  characteristics  of  the  sight  or  to 
"warm  up"  to  the  physical  requirements  of  the  controls. 

On  the  other  hand,  performance  on  five  of  the  six  criterion 
measures  for  TOPGUN  showed  highly  significant  stability  and 
reliability.  This  finding  may  be  related  to  the  relative  "ease" 
of  TOPGUN  exercises.  For  example,  post  test  questionnaires 
indicated  that  subjects  rated  TOPGUN  as  more  enjoyable  and  easier 
to  use  without  instructor  assistance.  In  addition,  the  TOPGUN 
engagements  were  rated  as  less  difficult  than  VIGS  or  ICOFT 
engagements.  Another  related  explanation  for  why  VIGS 
reliabilities  are  consistently  lower  than  those  for  TOPGUN  may  be 
that  TOPGUN  is  more  skill-dependent,  so  that  individual 
differences  in  skill  levels  become  apparent  early  and  then  these 
differences  in  subject  performances  are  maintained  throughout 
subsequent  sessions.  This  is  reflected  in  a  relatively  rigid 
ordering  of  individuals  with  regard  to  task  proficiency. 
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Table  6 


TOPGUN  and  VIGS  Retest  Reliabilities  and  Estimated  Reliabilities 
for  Six  Criterion  Measures 


Retest  Reliability  Estimated 


Criterion 

Trial  1-2 

Trial  2-3 

Trial  3-4 

Reliability 

TOPGUN 

Elevation  Error 

.  1  5 

.44* 

.37 

.29 

Azimuth  Error 

.39* 

.73** 

.60** 

.45** 

Time  to  Fire 

.82** 

.83** 

.81** 

.79** 

Time  to  Kill 

.84** 

.83** 

.80*'* 

.  78** 

Perf.  Score 

.47** 

.62** 

.50** 

.43** 

Hit  Percentage 

.  52** 

.58** 

.45** 

.41  ** 

VIGS 

Elevation  Error 

.27 

.03 

.21 

.18 

Azimuth  Error 

.69** 

-.13 

.  53** 

.18 

Time  to  Fire 

.  52** 

.21 

.34 

.35 

Time  to  Kill 

.  50** 

.23 

.26 

.34 

Perf.  Score 

.45* 

.33 

.52* 

.42* 

Hit  Percentage 

.44* 

.15 

.45* 

.27 

Note.  N  =  39. 

*  p  <  . 0 1 .  **  p  <  . 00 1  . 
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No  repeated  testing  could  be  accomplished  on  the  ICOFT 
because  of  logistical  constraints;  however,  criterion  measures 
were  correlated  across  exercises  to  determine  whether  there  were 
consistencies  in  performances  throughout  ICOFT  training.  For  the 
five  criterion  measures,  average  estimated  reliabilities  were  .15 
for  time  to  fire,  .18  for  time  to  kill,  .33  for  TA  error,  .33  for 
RA  grade,  and  .27  for  hit  percentage.  None  of  these  values  was 
statistically  significant.  This  analysis,  however,  tends  to 
grossly  underestimate  the  true  reliabilities.  Campshure,  Witmer, 
and  Drucker  (1990)  have  devised  a  more  appropriate  way  to  assess 
the  reliability  of  dependent  measures  across  engagements  that 
differ  in  difficulty  level.  However,  the  Campshure  et  al.  (1990) 
reliability  analysis  requires  obtaining  intercorrelations  of  each 
measure  across  engagements,  and  ICOFT  data  in  the  current  study 
were  coded  by  exercise  rather  than  by  engagement.  Whether  the 
analysis  would  be  meaningful  using  such  averaged  data  is 
questionable.  However,  the  averaged  data  upon  which  reliability 
estimates  are  based  appear  in  Appendix  0. 

Relationships  Among  Criterion  Measures  for  Each  Device. 

Table  7  presents  the  intercorrelations  among  criterion  measures 
for  the  three  gunnery  trainers  for  the  combined  VIGS-first  and 
TOPGUN-first  groups  (N  =  37).  The  N  shrank  because  of  some 
missing  values.  The  intercorrelations  were  obtained  by  first 
calculating  the  average  score  across  engagements  for  each  subject 
and  then  correlating  the  averages.  For  all  devices,  time  to  fire 
and  time  to  kill  were  highly  correlated.  However,  the  high 
correspondence  between  speed  measures  is  due  to  the  artifact  of 
using  only  round  one  data  in  the  analysis;  i.e.,  if  the  round 
failed  to  kill  the  target,  time  to  kill  was  coded  as  a  missing 
value  and  therefore  was  not  entered  in  the  correlation  matrix. 
Average  elevation  and  azimuth  errors  on  TOPGUN  and  VIGS,  because 
they  were  highly  unreliable,  did  not  correlate  significantly  with 
any  other  measures  of  proficiency,  and  for  that  reason  such 
aiming  errors  were  not  included  as  ICOFT  measures  in  favor  of  the 
more  reliable  reticle  aim  (RA)  composite  grade.  For  each  of 
TOPGUN,  VIGS,  and  ICOFT,  composite  performance  scores  were  highly 
related  to  hit  percentage  scores. 

As  expected,  speed  scores  were  highly  related  to  composite 
performance  scores  for  TOPGUN  and  VIGS  and  to  Reticle  Aim  grades 
(all  in  the  negative  direction)  for  ICOFT,  illustrating  the 
common  speed  vs.  accuracy  tradeoff  relationship:  That  is,  greater 
speed  is  related  to  greater  inaccuracy  in  target  acquisition. 
Despite  these  observations,  it  should  be  noted  that  most  of  the 
"significant”  correlations  in  Table  7  cannot  be  interpreted 
unambiguously  in  a  meaningful  way. 
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Table  7 


Intercorrelations  Among  Criterion  Measures 
for  the  Three  Gunnery  Trainers 

Criterion  Measure 


TOPGUN 

El . Ave . 

Az . Ave. 

Time  Fire 

Time  Kill 

Score 

Hit% 

Elev.  Error 

— 

.30 

-.19 

-.20 

-.05 

-.15 

Azim.  Error 
Time  Fire 
Time  Kill 
Perf.  Score 
Hit  Percent 

-.25 

-.27 

.99** 

-.06 

-.39* 

-.38* 

-.07 
-.18 
-.17 
.91  ** 

VIGS 

E 1 .Ave . 

Az .Ave . 

Time  Fire 

Time  Kill 

Score 

Hit% 

Elev.  Error 

— 

-.1  5 

.24 

.21 

-.37 

-.31 

A2im.  Error 
Time  Fire 
Time  Kill 
Perf.  Score 
Hit  Percent 

.04 

.03 

.99** 

-.12 

-.54** 

-.50** 

-.21 

-.28 

-.22 

.79** 

ICOFT 

Time  Fire  Time  Kill  TA 

Error  RA 

Grade 

Hit% 

Time  Fire 
Time  Kill 

TA  Error 

RA  Grade 

Hit  Percent 

• 

80** 

1 1 

18 

.49** 

.43* 

.77** 

.21 

.07 

-.61 ** 
.47* 

Note.  N  =  37. 

*  p  <  . 0 1 .  **  p  <  . 00 1 . 

Cross-correlating  Gunnery  Performance  Across  Devices. 

Because  all  three  devices  were  designed  to  train  tank  gunnery 
performance,  performances  measured  on  one  device  should  be 
related  to  performance  on  the  other  devices.  Table  8  shows 
correlations  between  various  averaged  measures  of  gunnery 
performance  on  TOPGUN,  VIGS,  and  ICOFT.  Positive  correlations  do 
not  demonstrate  a  causal  link  between  performances,  but  do 
suggest  that  common  skills  or  abilities  are  required  for 
proficiency.  There  were  no  significant  correlations  between 
TOPGUN  and  VIGS.  This  may  be  a  function  of  lack  of  criterion 
reliability  in  one  or  both  of  the  devices.  TOPGUN  speed  measures 
(time  to  fire,  time  to  kill)  correlated  significantly  with 
similar  ICOFT  measures,  but  accuracy  measures  (hit  percent, 
performance  scores)  showed  no  significant  correlations.  Time  to 
fire  was  also  significantly  correlated  between  VIGS  and  ICOFT, 
but  to  a  lesser  degree,  suggesting  that  the  two  devices  may 
measure  a  common  ability.  Thus,  TOPGUN  and  VIGS  may  predict  speed 
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on  ICOFT  with  TOPGUN  possibly  yielding  better  predictions.  On  the 
other  hand,  VIGS  performance  scores  were  highly  related  to 
similar  ICOFT  composite  measures  (target  acquisition,  reticle 
aim).  In  addition,  the  time  to  fire  scores  for  VIGS  and  ICOFT 
were  significantly  correlated.  Again,  it  is  not  surprising  that 
high  correlations  between  VIGS  and  ICOFT  were  found  for 
performance  scores  because  the  performance  score  is  the  only 
score  which  demonstrated  reliability  for  VIGS.  Because  ICOFT 
elevation  and  azimuth  errors  were  not  used,  hit  percentage  is  the 
best  accuracy  measure  available  on  ICOFT.  However,  the  .08 
correlation  between  hit  percentage  on  VIGS  and  ICOFT  suggests  no 
relationship  between  accuracy  on  the  two  devices. 

Similar  cross-correlations  were  also  performed  between 
criterion  measures  of  each  device  by  trial  to  determine  whether 
practice  would  increase  the  size  of  the  inter-device 
correlations.  There  were  no  significant  correlations  on  Trial  1. 
TOPGUN  and  ICOFT  speed  measures  started  to  correlate  on  Trials  2 
(fire  r  =  .56,  kill  r  =  .53)  and  3  (fire  r  «  .60,  kill  r  *  .53) 
and  remained  significant  on  Trial  4  (fire  r  =  .48,  kill  r  *  .41). 
VIGS  and  ICOFT  speed  measures  did  not  correlate  significantly 
until  Trial  4  (fire  r  =  .46,  kill  r  =  .44),  so  that  by  Trial  4, 
all  speed  scores  were  significantly  correlated,  ranging  from  .41 
to  .48.  The  VIGS  performance  score  also  correlated  significantly 
on  Trial  3  with  ICOFT  target  acquisition  (TA)  error  (r  =  -.40) 
and  reticle  aim  (RA)  grade  (r  =  .42).  In  addition,  the  VIGS 
performance  score  correlations  with  ICOFT  TA  and  RA  scores 
increased  to  -.48  and  .46  on  Trial  4,  respectively.  These  data 
suggest  that  four  trials  (108  engagements  per  device)  may  not  be 
sufficient  to  demonstrate  true  relationship  between  devices. 

Table  8 

Cross-Correlations  of  Criterion  Measures  Between 
the  Three  Gunnery  Trainers 


Criterion 

TG/VIGS 

TG/ICOFT 

VIGS/ICOFT 

Elevation  Error 

-.1696 

Azimuth  Error 

.0997 

Time  to  Fire 

.3697 

. 5331 ** 

.3848* 

Time  to  Kill 

.3769 

.4734* 

.2916 

Hit  Percentage 

.0446 

.  3825 

.0795 

Performance 

.  2853 

-.1438  (TA) 

-.5139**  (TA) 

Scores 

.3053  (RA) 

-.5552**  (RA) 

Note.  N  =  37. 

*  p  <  .01.  **  p  <  .001. 
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Transfer  of  Training 


Analysis  of  variance  is  preferred  to  correlation  as  a  method 
to  demonstrate  transfer.  To  determine  jointly  whether  learning 
occurred  during  TOPGUN  and  VIGS  training  (trial  effect)  and 
whether  performance  on  one  device  transferred  to  the  other  (group 
effect),  analyses  of  variance  was  applied  to  six  performance 
criteria  common  to  TOPGUN  and  VIGS.  Table  9  presents  results  of 
the  analysis  of  variance  (ANOVA).  Significant  main  effects  were 
found  for  Group  and  Trial  on  both  speed  measures  (time  to  fire, 
time  to  kill)  and  two  accuracy  measures  (hit  percentage, 
performance  score)  for  both  TOPGUN  and  VIGS.  In  all  cases,  the 
group  which  had  received  prior  training  on  the  alternate  device 
performed  better.  Average  elevation  and  azimuth  errors  were  too 
erratic  to  produce  consistent  or  interpretable  results.  No 
interactions  were  statistically  significant. 
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Table  9 


Analyses  of  Variance 
Trial 

for  TOPGUN 

and  VIGS  Criteria 

by  Group  and  by 

F-Ratios 

for  ANOVA 

Device/Cr iter ion 

Group 

Trial 

X 

Group 
:  Trial 

TOPGUN 

Time  to  Fire 

14.38** 

15.25** 

1.12 

Time  to  Kill 

14.16** 

1 4 . 36** 

.96 

Elevation  Error 

.81 

1 .61 

1  .34 

Azimuth  Error 

7.83* 

.54 

.  1  2 

Hit  Percentage 

10.30* 

12.61** 

1.21 

Performance  Score 

12.96** 

15.49** 

1  .53 

VIGS 

Time  to  Fire 

15.45** 

15.55** 

3.26 

Time  to  Kill 

13.61** 

13.53** 

2.91 

Elevation  Error 

.39 

7.03** 

.04 

Azimuth  Error 

.35 

1 .76 

.40 

Hit  Percentage 

1 1 .35** 

16.05** 

.76 

Performance  Score 

1 1  .93** 

33.39** 

.20 

Note.  Group  df  =  1 , 

Trial  df  = 

3,  Total  df  =  159. 

*  p  <  .01 .  **  p  <  .001 . 


Transfer  of  Training  from  VIGS  and  TOPGUN  to  ICOFT.  Table 
10  presents  ANOVA  summaries  comparing  control,  TOPGUN-f irst ,  and 
VIGS-first  groups  on  their  ICOFT  performances,  and  contrasts  were 
performed  to  determine  if  groups  differed  significantly  in 
performance.  Groups  did  not  differ  on  time  to  fire  or  time  to 
kill  speed  measures.  However,  the  experimental  groups 
significantly  outperformed  the  control  group  on  all  other 
criterion  measures.  Inspection  of  means  indicates  that  there  was 
no  perceptible  difference  between  the  TOPGUN-first  or  VIGS-first 
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groups  except  for  the  TA  error  measure,  where  the  TOPGUN-first 
group  performed  significantly  better  than  the  VIGS-first  group. 

However,  when  we  determined  transfer  using  Trial  4  data  only 
for  TOPGUN-First  and  VIGS-First  groups  and  ICOFT  scores  as 
dependent  measures,  we  found  that  the  TOPGUN-First  group  was 
superior  for  TA  error  (F  =  6.18,  df  =  1,36,  p  <  .02)  and  RA  grade 
(F  *  5.54,  df  =  1,36,  p  <  .02).  The  mean  TA  score  for  TOPGUN- 
First  vs.  VIGS-First  was  1.50  vs.  3.78,  and  for  RA  score  was  1.75 
vs.  1.39,  respectively.  Thus,  with  as  few  as  four  sessions 
practice,  TOPGUN-First  subjects  are  superior  in  terms  of  transfer 
to  ICOFT  composite  measures.  In  addition,  the  TOPGUN-First  group 
demonstrated  faster  performance  scores  on  time  to  fire  (TOPGUN  = 
15.69,  VIGS  =  16.00)  and  time  to  kill  (TOPGUN  =  16.90,  VIGS  = 
18.59)  criteria  and  higher  hit  percentage  (TOPGUN  =  29.80,  VIGS  = 
25.69)  scores,  although  these  differences  were  not  statistically 
significant.  Whether  TOPGUN  would  be  superior  to  VIGS  when  used 
alone  before  transfer  to  ICOFT  cannot  be  determined  because  of 
the  interpolated  practice  on  the  alternate  device. 
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Table 


10 


Means,  Standard  Deviations  and  One-way  Analysis  of 
Variance  of  ICOFT  Criterion  Measures  by  Group 


Group  Means  and  Standard  Deviations  (in  parentheses) 


TOPGUN- 

VIGS- 

Criterion 

Control 

First 

First 

F  (df  =2,56) 

Time  to  Fire 

17.19 

16.41 

16.36 

2.50 

(1.44) 

(1.23) 

(1.15) 

Time  to  Kill 

18.23 

17.61 

17.52 

1  .25 

(1.95) 

(1.29) 

(1.15) 

TA  Error 

3.81 

1  .60 

2.07 

9.65** 

(2.36) 

( 0.77  ) 

(1.40) 

RA  Grade 

1  .84 

2.24 

2.24 

9.79** 

( 0.82  ) 

(0.30) 

(0.38  ) 

Hit  Percentage 

65.20 

80.59 

79.44 

13.51** 

(11.36) 

(8.96) 

(10.18) 

Note.  Control  N 

=  19,  TOPGUN-First  N 

=  20,  VIGS- 

-First  N  =  18. 

**  p  <  .001. 

Predicting  Performance  on 

Tank  Gunnery 

Simulation 

Devices 

As  discussed  earlier,  the  prediction  of  complex 
performances,  such  as  those  involved  in  tank  gunnery,  depends  on 
finding  tests  that  are  stable  and  reliable. 

Differential  Stability  and  Reliability  of  Predictors. 
Differential  stability  has  been  described  as  the  determination  of 
the  number  of  trials  that  are  needed  for  the  trial-to-trial 
intercorrelations  to  stabilize.  It  represents  the  point  at  which 
there  is  stable  relative  ordering  of  individuals  over  repeated 
testings.  Inspection  of  the  trial-to-trial  intercorrelations  and 
estimation  of  the  "trial  of  stability"  for  each  test's 
performance  measures  has  implications  for  the  stability  and 
potential  reliability  of  those  measures  (Jones,  1980;  Jones  et 
al.,  1981).  Therefore,  trial-to-  trial  intercorrelations  were 
obtained  for  all  repeated  measures.  An  estimate  of  stability  is 
given  by  taking  the  average  of  all  correlations  in  a 
trial-to-trial  correlation  matrix,  following  the  trial  at  which 
intertrial  correlations  plateau. 
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Table  11  presents  the  overall  means  and  standard  deviations, 
retest  reliabilities,  and  the  estimated  reliabilities  for  the 
APTS  tests  across  trials.  "Estimated  reliability",  one  index  of 
differential  stability,  is  the  average  of  all  correlations  in  the 
intertrial  correlation  matrix,  not  just  the  off-diagonals  which 
give  information  about  test-retest  reliability.  As  shown  in  Table 
11,  all  APTS  tests  were  highly  reliable,  with  all  except  Math 
Processing  and  Four-Choice  Reaction  Time  having  estimated 
reliability  correlations  greater  than  .707,  the  value  at  which 
50%  of  the  variance  is  explained.  In  addition,  but  relatedly,  all 
means  and  standard  deviations  stabilized  early.  Stability  of 
means  and  standard  deviations  is  determined  subjectively  by 
determining  at  what  trial  values  start  to  plateau;  the  estimated 
trial  of  stability  is  then  checked  by  a  second  analyst,  and, 
where  there  are  disagreements,  a  consensus  is  reached  (Turnage, 
Kennedy,  &  Osteen,  1987). 

Table  1 1 

Overall  Means  and  Standard  Deviations,  Retest  and  Estimated 
Reliabilities  for  APTS  Scores  Across  Trials 


Retest  Reliability  Estimated 

Test  Mean  SD  Trial  1-2  Trial  2-3  Reliability 


NPTAP 

32.98 

8.93 

.76 

.88 

.76 

THTAP 

36.65 

7.22 

.80 

.77 

.76 

RTARL 

.48 

.09 

.90 

.93 

.92 

CSNC 

52.32 

8.19 

.75 

.76 

.73 

CSARL 

2 . 07 

.31 

.76 

.74 

.73 

GR 

27.51 

6.93 

.65 

.77 

.68 

GRARL 

3.53 

.85 

.69 

.81 

.71 

MKNC 

60.55 

11.04 

.85 

.86 

.83 

MKARL 

1  .66 

.  39 

.89 

.89 

.86 

PCNC 

84.55 

12.15 

.85 

.84 

.84 

PCARL 

1  .04 

.22 

.87 

.85 

.84 

MPNC 

31.76 

7.58 

.70 

.66 

.67 

MPARL 

1.11 

.  1  1 

.67 

.66 

.61 

Note .  N  =  59.  All  significant  at  p  <  .001. 

Table  12  presents  the  intertrial  (retest  and  estimated) 
reliabilities  for  the  five  contrast  sensitivity  frequencies  of 
VISTECH  charts,  summed  across  the  three  charts.  The  very  high 
reliabilities,  particularly  the  higher  spatial  frequencies, 
corroborate  recent  work  by  Kennedy  (1989),  which  found  that 
VISTECH  measures  of  contrast  acuity  taken  repeatedly  (15  trials) 
achieved  temporal  stability  after  only  one  administration. 
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Table  12 


Retest  and  Estimated  Reliabilities  for  Five  Contrast  Sensitivity 
Frequencies 


Spatial  Freq 


Retest  Reliability 
Trial  1-2  Trial  2-3  Trial  3-4 


Estimated 

Reliability 


FREQ1  (1.5  Cycles) 

.60 

.51 

.50 

.51 

FREQ2  (3  Cycles) 

.84 

.70 

.75 

.68 

FREQ3  (6  Cycles) 

.84 

.70 

.75 

.68 

FREQ4  (12  Cycles) 

.86 

.80 

.86 

.80 

FREQ5  (18  Cycles) 

.88 

.74 

.88 

.82 

Note .  N  -  59.  All  significant  at  p  <  .001. 


The  means,  standard  deviations,  and  intertest  correlations 
of  ASVAB  and  WOFO  scores  are  presented  in  Table  13.  ASVAB  scores 
for  the  student  subject  population  used  in  this  study  were 
similar  to  actual  ASVAB  norms  for  the  tank  gunner  MOS  (Grafton, 
personal  communication,  1989).  The  mean  norms  for  the  1980  ASVAB 
test  scores,  which  were  the  latest  data  available  from  the  U.S. 
Army  Research  Institute,  were:  General  Science,  16;  Coding  Speed, 
48;  Mechanical  Comprehension,  14;  Electronics  Information,  11.5; 
and  Auto  and  Shop  Information,  14.5.  Inspection  of  Table  13  also 
reveals  that  ASVAB  tests  1,3, 4, and  5  were  positively  correlated, 
possibly  indicative  of  a  common  intelligence  (or  G)  factor,  and 
were  negatively  correlated  with  coding  speed  (ASVAB  2).  All  WOFO 
achievement  motivation  scores  were  highly  correlated. 
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Table  13 


Means,  Standard  Deviations,  and  Intertest  Correlations  of  ASVAB 
and  WOFO  Predictor  Scores 


Predictor  Mean  SD 


Intercorrelations 


ASVAB 

ASVAB1 

ASVAB2 

ASVAB3  ASVAB4 

ASVAB5 

1-Gen.  Scierce 

15.67 

3.58 

— 

-.09 

.31*  .27 

.53** 

2-Codir.g  Speed 

48.43 

11.57 

— 

-.14  -.05 

-.03 

3-A&S  Info. 

14.57 

3.02 

.56** 

.48** 

4-Mech.  Comp. 

13.18 

3.80 

— 

.51** 

5-Elec.  Info. 

9.05 

2 . 69 

— 

WOFO 

WOF0 1 

W0F02 

W0F03 

W0F04 

1 -Mastery 

2.18 

2.10 

— 

.  56 ** 

.46** 

.44** 

2-Work 

3.97 

1  .60 

— 

.  42** 

.46** 

3-Competition 

1  .53 

1.61 

-- 

.30 

4-Pers.  Unc. 

1.18 

1  .  00 

— 

Note.  N  =  60. 

*  p  <  .01.  **  p  <  .001. 


Table  14  presents  the  intertest  correlations  for  APTS  3nd 
VISTECH  predictors,  based  on  scores  summed  over  three  trials  for 
APTS  and  four  trials  for  VISTECH.  Average  response  latency  scores 
for  APTS  tests  were  dropped  from  this  and  further  analyses 
because  past  research  (Turnage,  Kennedy,  &  Osteen,  1987)  has 
indicated  correlations  between  number  correct  and  latency 
measures  to  exceed  .90,  indicating  that  use  of  both  scores  would 
be  redundant.  Several  APTS  tests  (e.g..  Manikin,  Grammatical 
Reasoning)  showed  high  correlations  with  other  tests,  and  all 
VISTECH  scores  were  highly  intercorrelated .  Ir.  general,  while 
intertest  correlations  within  the  four  predictor  sets  was 
moderately  high,  there  appeared  not  to  be  sufficient  reason  to 
discard  or  combine  any  scores  from  the  predictor  sets  for  further 
analyses  because  we  were  interested  in  retaining  as  many 
potential  predictors  as  possible  at  this  stage  of  analysis. 
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ntertest  Correlations  for  APTS  and  VISTECH  Predictors,  Summed  Across  Trials 
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Cross-Task  Correlations  Among  Predictor  Scores 


To  determine  the  degree  to  which  individual  tests  from  all 
predictor  batteries  shared  common  variance,  a  cross-task 
intercorrelation  matrix  was  constructed.  There  were  very  few 
significant  correlations,  the  only  ones  being  VISTECH  frequencies 
1  and  2  with  Math  Processing  (.31  and  .32,  respectively),  VISTECH 
Frequency  4  with  WOFO  Mastery  (.31),  ASVAB  General  Science  with 
WOFO  Work  (-.44),  and  ASVAB  Coding  Speed  with  APTS  Code 
Substitution  (.40)  and  Manikin  (.38).  These  results  indicate  that 
predictor  sets  were  relatively  independent. 

Correlations  and  Regressions  of  Predictors  with  Criterion  Scores 

To  determine  whether  biographical  variables,  APTS,  ASVAB, 
VISTECH,  and  WOFO  scores  would  predict  gunnery  performance 
measures,  all  predictors  were  correlated  with  all  criterion 
scores  for  Groups  1  and  2  combined  (N  =  37).  Of  the  biographical 
variables,  only  two  related  significantly  to  any  criterion 
performance:  Time  in  ROTC  was  negatively  correlated  (r  =  -.50, 
p  <  .001)  with  ICOFT  hit  percent  scores.  There  is  no  apparent 
reason  for  this  relationship.  Time  spent  playing  video  games  was 
positively  correlated  (r  =  .45,  p  <  .01)  with  APTS  reaction  time, 
a  not  unexpected  finding. 

The  other  predictor  scores  were  correlated  by  group  to  the 
respective  criterion  performances,  where  criteria  were  summed 
across  trials  for  TOPGUN  and  VIGS  measures.  The  TOPGUN-first 
group  contained  19  subjects,  the  VIGS-first  group  contained  18 
subjects,  and  the  control  group  contained  18  subjects,  because  of 
some  shrinkage  due  to  missing  data.  Thus  for  each  group,  5 
VISTECH,  5  ASVAB,  8  APTS,  and  4  WOFO  scores  were  used  to  predict 
either  5  or  6  criterion  scores,  based  upon  the  reference  group. 
There  were  few  significant  correlations,  probably  due  at  least  in 
part  to  small  sample  sizes.  However,  when  the  groups  were 
combined  (N  =  37),  there  were  statistically  significant  (p  <  .01) 
correlations  between  ASVAB  mechanical  comprehension  scores  and 
VIGS  performance  scores  (for  VIGS  time  to  fire,  r  =  -.39,  for 
performance  score,  r  =  .49,  and  for  hit  percentage,  r  =  .42); 
between  VISTECH  contrast  sensitivity  ( FREQ1 )  and  TOPGUN  and  ICOFT 
scores  (for  TOPGUN  time  to  fire  and  time  to  kill,  r  =  -.41  and 
-.40,  respectively,  and  for  ICOFT  time  to  kill,  r  =  -.40); 
between  both  APTS  tapping  tests  and  VIGS  time  to  fire  and  time  to 
kill  (all  r's  =  .42);  between  various  APTS  scores  (4-Choice 
Reaction  Time,  Code  Substitution,  Math  Processing)  and  VIGS  and 
ICOFT  composite  accuracy  scores  (reaction  time  r  =  -.42  with  VIGS 
performance  score  and  r  =  -.40  with  VIGS  hit  percentage,  code 
substitution  r  =  .39  with  VIGS  performance  score,  and  math 
processing  r  =  .41  with  ICOFT  target  acquisition  score);  and 
between  the  WOFO  personal  unconcern  score  and  the  TOPGUN 
performance  score  (r  =  -.38). 
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A  common  procedure  used  to  correct  for  inherent 
unreliability  of  variables  is  Spearman's  (1904)  correction  for 
attenuation  formula,  which  utilizes  estimated  reliabilities  of 
both  predictor  and  criterion  variables  to  project  "true” 
correlations.  Using  estimated  reliabilities  for  TOPGUN  and  VIGS 
(Table  6),  VISTECH  (Table  12),  and  APTS  (Table  11),  the  above 
correlations  were  corrected  as  follows:  VISTECH  FREQ1  with  TOPGUN 
time  to  fire  and  kill,  r  =  -.65  and  -.63,  respectively;  TFTAP 
with  VIGS  time  to  fire  and  kill,  r  ■  .81  and  .83,  respectively; 
NPTAP  with  VIGS  time  to  fire  and  kill,  r  =  .81  and  .83, 
respectively;  4-Choice  Reaction  Time  with  VIGS  performance  score 
and  hit  percentage,  r  =  -.68  and  -.80,  respectively;  and  Code 
Substitution  number  correct  with  VIGS  performance  score,  r  =  .70. 
This  correction  indicates  the  true  relation  between  variables  if 
the  predictor  and  criterion  variables  were  perfectly  reliable. 

Although  it  would  have  been  possible  to  find  more  potential 
predictors  of  ICOFT  by  using  all  data  for  all  three  groups,  when 
this  analysis  was  performed  (N  =  56),  the  only  meaningful  ICOFT 
predictor  was  APTS  Four-Choice  Reaction  Time,  which  was 
significantly  correlated  with  ICOFT  time  to  fire  (r  =  .34,  p  < 

.01  ),  TA  error  (r  =  .67,  p  <  .001  ),  and  RA  grade  (r  =  -.38,  p  < 

.  01  ) . 


To  determine  the  significant  predictors  of  trainee 
performances  for  the  three  gunnery  trainers,  multiple  regressions 
were  run  using  the  22  predictors  as  independent  variables  and 
each  criterion  measure  as  dependent  variables.  The  stepwise 
selection  method  was  used.  Stepwise  selection  is  a  combination  of 
backward  and  forward  procedures,  where  the  first  variable 
selected  is  the  independent  variable  with  the  highest 
correlation,  the  second  is  that  with  the  highest  partial 
correlation,  etc.  When  variables  can  no  linger  meet  the  PIN  =  .05 
entry  requirement  (i.e.,  they  increase  the  F  value  at  least  .05), 
then  the  backward  elimination  procedure  takes  over  to  remove 
variables  in  the  equation  that  fail  to  meet  the  POUT  =  .10 
removal  criterion  (i.e.,  they  decrease  the  F  value  at  least  .10). 
The  results  are  summarized  in  Table  15.  Although  it  is  recognized 
that  the  expected  value  of  R  equals  1.00  when  the  number  of 
independent  variables  equals  the  number  of  subjects,  there  were 
several  reasons  for  using  the  large  predictor  set.  First,  each 
predictor  set  was  selected  because  previous  research  had  shown 
relations  between  predictors  and  criteria;  thus,  this  was  not  a 
"shotgun"  approach.  Second,  although  some  predictor  sets, 
especially  VISTECH  scores,  demonstrated  high  internal 
correlations,  there  were  no  clear  reasons  to  develop  composite 
scores  when  the  multiple  regression  process  would  automatically 
exclude  highly  correlated  scores.  Last,  and  perhaps  most 
importantly,  the  use  of  three  distinct  groups  allows  one  to 
compare  whether  criterion  variance  is  explained  by  the  same 
predictors  across  devices,  thus  providing  a  powerful  form  of 
cross-validation. 
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Table  15 


Summary  of  Number  of  Significant  Predictors  from  Stepwise 
Regression  of  All  Predictors  (22)  with  Criteria  from  Three 
Training  Devices 


ICOFT 

TOPGUN 

VIGS 

Total 

Exp. 

TOPGUN- 

Exp. 

VIGS- 

Exp. 

Sample 

Control 

Group 

First 

Group 

First 

Group 

Predictor 

( N=55  ) 

( N=  1  7  ) 

(N=37  ) 

( N= 1 8  ) 

( N=  38  ) 

( N= 1 9  ) 

( N=  39 ) 

ASVAB1 

ASVAB2 

1 

1 

2 

ASVAB3 

2 

3 

2 

2 

1 

ASVAB4 

1 

2 

ASVAB5 

W0F01 

W0F02 

1 

4 

W0F03 

W0F04 

FREQ1 

1 

1 

1 

FREQ2 

FREQ3 

FREQ4 

1 

1 

1 

FREQS 

NPTAP 

TFTAP 

CSNC 

1 

1 

1 

1 

4 

PCNC 

1 

2 

2 

GRNC 

MKNC 

MPNC 

1 

2 

1 

RTARL 

3 

2 

1 

2 

Note .  Full  predictor  labels  appear  in  Table  1 . 
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Table  15,  which  lists  significant  predictors  of  all  criteria 
from  the  three  devices,  indicates  that  there  were  few  significant 
predictors,  in  line  with  the  results  that  were  found  when  each 
predictor  was  individually  correlated  with  each  criterion.  The 
first  three  columns  show  that  there  were  only  8  statistically 
significant  predictors  of  ICOFT  criteria  using  the  total  sample 
(N  *  56),  9  using  the  control  group  only  (N  =  17),  and  7  using 
both  experimental  groups  (N  =  37).  Only  1  predictor  was 
statistically  significant  for  TOPGUN  criteria  using  the  TOPGUN- 
First  group,  and  4  were  using  the  two  experimental  groups.  On  the 
other  hand,  17  predictors  showed  statistically  significant 
relations  with  VIGS  criteria  for  the  VIGS-First  group,  and  7  were 
significant  for  the  total  experimental  group.  In  most 
regressions,  the  multiple  R  failed  to  exceed  .707,  which  when 
squared,  signifies  that  50%  of  the  criterion  variance  has 
sufficiently  been  accounted  for  by  the  predictors.  Exceptions 
were:  1 )  ICOFT  TA  error  predicted  by  RTARL,  ASVAB3 ,  ASVAB5  (R  = 
.75),  and  ICOFT  time  to  fire  predicted  by  PCNC  and  FREQ4  (R  = 

.84)  for  the  total  sample;  2)  ICOFT  TA  error  predicted  by  RTARL, 
ASVAB3  (R  =  .94),  and  ICOFT  RA  grade  predicted  by  RTARL,  PCNC, 
ASVAB3  (R  =  .88)  for  the  control  group;  and  3)  VIGS  time  to  fire 
predicted  by  W0F02,  MKNC ,  RTARL,  PCNC,  ASVAB1 ,  FREQ3  (R  =  .95), 
VIGS  time  to  kill  predicted  by  MKNC,  W0F02,  RTARL,  PCNC,  ASVAB1 , 
W0F03  (R  =  .96),  and  VIGS  performance  score  predicted  by  CSNC, 
W0F02 ,  ASVAB3  (R  =  .76)  for  the  VIGS-first  group. 

Inspection  of  the  "patterns”  of  significant  predictors 
suggested  using  a  reduced  set  of  predictors  for  each  device  to 
conform  to  the  ratio  of  one  predictor  for  every  10  subjects  that 
is  more  acceptable  for  regression  research  than  the  previous 
analysis  in  which  the  number  of  predictors  equalled,  or  even 
exceeded,  the  number  of  subjects  in  some  cases.  ASVAB3,  PCNC,  and 
RTARL  were  selected  to  predict  all  ICOFT  criteria;  ASVAB2  and  3, 
WOFQ4,  and  FREQ1  were  chosen  for  TOPGUN  criteria;  and  W0F02, 

CSNC,  MKNC,  and  RTARL  were  selected  for  VIGS  criteria.  Stepwise 
regressions  were  then  run  on  the  total  ICOFT  group  (N  =  55)  and 
the  total  experimental  group  (N  =  38)  for  TOPGUN  and  VIGS 
criteria.  Results  are  reported  in  Table  16.  It  can  be  seen  that 
none  of  the  multiple  correlations  was  exceptionally  high,  as  only 
9  prediction  equations  achieved  statistical  significance  over  all 
training  criteria.  When  the  adjusted  R*  is  applied  to  reflect  how 
well  the  model  fits  the  population,  the  results  are  further 
diminished  in  value.  Although  there  were  some  suggestions  about 
skills  that  may  underlie  performances  on  each  device, 
interpretations  based  on  these  data  would  need  to  be  cautious. 
However,  it  would  appear  that  contrast  sensitivity,  coding  speed, 
and  some  knowledge  of  specific  mechanical  principles  predicts 
TOPGUN  performance.  It  is  curious  that  W0F04 ,  which  measures 
attitudes  about  the  possible  negative  consequences  of  achievement 
(i.e.,  fear  of  success)  was  positively  related  to  the  TOPGUN 
performance  score.  Code  Substitution,  which  involves  cognitive 
and  perceptual  processing  featuring  rapid  visual  search  encoding 
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and  decoding,  appears  to  predict  VIGS  performance.  ICOFT 
performance,  on  the  other  hand,  appears  to  be  primarily  predicted 
by  response  speed  and  knowledge  of  mechanical  principles,  at 
least  in  early  learning  stages  as  represented  in  this  study. 

Thus,  because  performance  on  different  devices  is  predicted  by 
different  predictors,  it  may  be  that  there  are  fundamental 
differences  in  the  designs  of  these  devices  or  the  sensitivity  of 
their  performance  measurement  systems  to  diverse  operator  inputs. 
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Table  16 


Summary  of  Significant  Predictors  of  Trainee  Performances  for  the 
Three  Trainers  Using  Reduced  Set  of  Predictors 

Trainer/Criterion  Significant  Predictcr(s)  R  R2  Adj.R2 


TOPGUN  (N  =  38) 

Time  to  Fire 

FREQ1 

.43* 

.19 

.16 

Time  to  Kill 

FREQ1 

.34* 

.12 

.10 

Perf.  Score 

W0F04 , 

ASVAB2 , 

ASVAB3 

.59** 

.35 

.30 

VIGS  (N  =  39) 

Perf.  Score 

CSNC 

.49** 

.24 

.22 

Hit  Percentage 

CSNC 

.41  * 

.  1  7 

.  1  5 

ICOFT  (N  =  55 ) 

Time  to  Fire 

RTARL 

.34* 

.12 

.  1  0 

TA  Error 

RTARL , 

ASVAB3 

.72** 

.52 

.50 

RA  Grade 

RTARL 

.38* 

.15 

.13 

Hit  Percentage 

RTARL, 

ASVAB3, 

PCNC 

.49* 

.24 

.20 

Note.  *  p  <  .01.  **  p  <  .001. 

Finally,  an  analysis  was  performed  of  the  subject  opinion 
questionnaires  which  were  administered  immediately  after  ICOFT 
testing.  The  mean  responses  for  TOPGUN  and  VIGS  questions  are 
presented  in  Tables  17  and  18.  In  general,  subjects  enjoyed 
training  on  both  devices  and  thought  the  devices  helped  them  to 
improve  or  learn  tank  gunnery  skills.  Subjects  experienced  more 
difficulty  with  VIGS  than  TOPGUN,  but  were  fairly  evenly  divided 
as  to  which  device  they  would  use  to  train  on  if  given  a  choice. 
They  were  somewhat  equally  in  agreement  with  the  statement  that 
skills  trained  on  TOPGUN  (VIGS)  were  the  same  as  on  ICOFT,  but 
there  was  a  good  deal  of  variability  in  responses.  There  was 
equally  strong  support  for  the  effectiveness  of  prior  TOPGUN  and 
VIGS  training  in  helping  performance  on  ICOFT.  Specific  comments 
regarding  each  device  may  be  found  in  Appendix  P. 
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Table  17 


Mean  Rating  Scale  Values  for  TOPGUN  Questionnaire  Items 


TOPGUN  Items 


MEAN  SD 


1.  I  enjoyed  training  on  the  TOPGUN  device.  4.7  .71 

2.  TOPGUN  helped  me  to  improve/learn  tank  4.2  .74 

gunnery  skills. 

3.  If  I  could  see  the  target,  I  could  hit  it.  4.2  .78 

4.  Most  of  the  target  engagements  were  too  1.8  1.0 

difficult . 

5.  If  given  a  choice,  I  would  use  the  TOPGUN  3.2  1.2 

to  train  on. 

6.  I  could  use  TOPGUN  without  any  instructor  3.9  2.3 

assistance . 

7.  I  thought  TOPGUN  engagements  were  too  easy.  3.4  .87 

8.  I  had  trouble  finding  targets  on  TOPGUN.  1.9  1.0 

9.  I  liked  the  "unity  window"  for  locating  3.4  1.2 

targets . 

10.  The  skills  trained  on  TOPGUN  were  the  same  3.6  1.3 

as  on  ICOFT. 

11.  The  device  features  on  TOPGUN  (color  coding  3.7  .89 

of  targets,  etc. )  were  helpful  when  learning 

to  hit  the  targets. 

12.  Prior  TOPGUN  training  helped  my  performance  4.4  .77 

on  ICOFT. 


Note.  Rating  scale  values:  1  =  Strongly  disagree,  2  =  Disagree, 
3  =  Neither  agree  nor  disagree,  4  =  Agree,  5  =  Strongly  agree. 
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Table  18 


Mean  Rating  Scale  Values  for  VIGS  Questionnaire  Items 


VIGS  Items 

1.  I  enjoyed  training  on  the  VIGS  device. 

2.  VIGS  helped  me  to  learn/improve  my  gunnery 
skills . 

3.  If  I  could  see  the  target,  I  could  hit  it. 

4.  Most  of  the  engagements  were  too  difficult. 

5.  If  given  a  choice,  I  would  choose  the  VIGS 
to  train  on. 

6.  I  could  use  VIGS  without  any  instructor 
assistance . 

7.  I  thought  the  VIGS  engagements  were  too  easy. 

8.  I  had  trouble  finding  targets  on  VIGS. 

9.  I  was  confused  by  the  adjustments  required  by 
VIGS. 

10.  The  skills  trained  on  VIGS  were  the  same  as 
on  ICOFT. 

11.  The  voice  on  VIGS  was  difficult  to  understand. 

12.  Prior  VIGS  training  helped  my  performance  on 
ICOFT. 


Mean  SD 


4.4 

1  .0 

4.4 

.84 

3.7 

1  .0 

2.2 

.96 

3.4 

1  .3 

N) 

• 

-4 

1  . 2 

00 

• 

<N 

1  .  0 

2.2 

.84 

2.3 

1  .3 

3.5 

1  . 4 

2.8 

1  .3 

4.4 

.87 

Note.  Rating  scale  values:  1  =  Strongly  disagree,  2  =  Disagree, 
3  =  Neither  agree  nor  disagree,  4  =  Agree,  5  =  Strongly  agree. 
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DISCUSSION 


The  purpose  of  this  study  was  to  investigate  whether 
training  transfer  occurred  between  two  part-task  gunnery 
trainers,  TOPGUN  and  VIGS,  and  performance  on  a  high-fidelity 
trainer,  ICOFT.  With  respect  to  our  original  research  questions 
regarding  transfer,  we  found  that:  1)  performance  improved  at 
equal  rates  during  TOPGUN  and  VIGS  training;  2)  there  was 
significant  transfer  between  most  TOPGUN  and  VIGS  performances 
with  no  apparent  superiority  of  either  device;  3)  except  for 
speed  measures,  TOPGUN  and  VIGS  training  transferred  to  ICOFT, 
and  4)  there  was  no  apparent  difference  between  the  TOPGUN-VIGS 
or  VIGS-TOPGUN  sequences  of  training.  Although  there  is  no  clear 
reason  why  accuracy  but  not  speed  should  transfer,  a  likely 
explanation  would  be  the  nature  of  the  instructions  and  feedback, 
which  stressed  hits  more  than  speed.  Practice  on  devices  does 
seem  to  engender  a  pronounced  desire  to  hit  the  target,  and 
target  hits  are  more  directly  reinforced  by  the  subject  seeing 
the  target  disappear,  by  having  the  TC  pronounce  "cease  fire", 
and  by  providing  the  subject  with  immediate  performance  feedback. 
Although  speed  measures  influence  performance  scores,  their 
influence  on  gunnery  proficiency  is  not  so  visible  or  apparent. 

Witmer  (1988)  found  no  significant  transfer  between  VIGS  and 
UCOFT  as  we  did.  Differences  in  results  are  probably  a  function 
of  having  more  trials  of  VIGS  practice  in  this  study,  as  well  as 
hardware  differences  between  the  VIGS  used  in  Witmer' s  study 
(manufactured  by  Perceptronics )  and  the  VIGS  used  in  this  study 
(manufactured  by  E.C.C.).  These  results  are  also  generally 
consistent  with  past  research  (e.g.,  Witmer,  1988)  that 
demonstrated  instability  of  elevation  and  azimuth  errors,  and 
performance  improvement  as  a  function  of  practice.  However, 

Witmer  found  significant  correlations  between  VIGS  and  UCOFT  on 
hit  percentage  and  elevation  aiming  error  measures,  whereas  we 
found  significant  correlations  for  time  to  fire  and  kill  measures 
and  composite  performance  measures  but  not  for  hit  percentage. 
This  could  be  due  to  the  fact  that  hit  percentage  was  calculated 
differently  by  Witmer. 

In  comparing  our  data  to  preliminary  data  reported  by  Hagman 
(1989,  personal  communication)  who  studied  training  transfer 
between  TOPGUN  and  COFT,  we  found  evidence  for  transfer  over  all 
exercises  from  TOPGUN  to  COFT  (especially  for  Trial  4  data) 
whereas  Hagman  found  transfer  for  stationary  targets  only.  An 
analysis  has  been  conducted  to  discern  whether  transfer  occurs 
differentially  for  engagements  featuring  1 )  stationary  vs.  moving 
targets,  2)  single  vs.  multiple  targets,  and  3)  GPS,  GAS,  and  TIS 
sightings  for  both  TOPGUN  and  VIGS  devices  (Bliss,  1989). 

Evidence  of  transfer  in  this  study  can  in  part  be  attributed 
to  adherence  to  Boldovici’s  (1987)  guidelines,  enumerated  in  the 
introduction,  for  reduction  of  sources  of  error  in  transfer 
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experiments  with  military  training  devices.  For  example, 
comparison  groups  contained  19  or  20  subjects  each,  subjects  were 
randomly  assigned  to  groups,  and  groups  were  treated  similarly 
except  for  treatments  under  investigation.  For  example,  data 
collection  was  completely  standardized  by  the  use  of  prerecorded 
and  carefully  written  instructions,  the  requirement  for  subjects 
to  be  tested  at  exactly  specified  times,  and  the  automated 
recording  of  most  output  data.  Human-coded  data  were  checked  and 
double-checked  when  recorded  and  when  entered  onto  computer 
discs.  Likewise,  data  analysis  was  only  begun  after  a  thorough 
inspection  of  scores  to  spot  errors;  and  in  several  cases 
simulator  glitches  and  errors  led  to  elimination  of  faulty  data. 
These  procedures  are  necessary  to  produce  a  "clean"  data  set  on 
which  to  base  analyses  and  are  an  integral  part  of  establishing 
test  reliability.  On  the  other  hand,  certain  faults,  which  were 
found  in  TOPGUN  and  VIGS  presentations  and  in  coding  of  data, 
added  to  unreliability  of  data  (see  Appendix  P). 

In  addition,  we  attempted  to  provide  adequate  practice  to 
affect  proficiency.  However,  we  found  that  with  the  exception  of 
speed  scores,  performances  on  VIGS  were  still  improving  at  Trial 
4.  Had  performances  been  allowed  to  stabilize,  it  is  expected 
that  more  transfer  would  have  been  demonstrated.  This  point  also 
relates  to  Boldovici's  fifth  point,  that  measurement  of  the 
criterion  task  should  be  reliable.  In  this  study,  both  VIGS  and 
ICOFT  measures  had  questionable  reliabilities;  for  VIGS  this  was 
empirically  assessed,  and  for  ICOFT  it  would  have  to  be  presumed 
because  of  subject  inexperience,  the  relative  complexity  of  the 
device  and  engagements,  and  the  use  of  only  one  trial.  It  is 
possible  the  hypotheses  regarding  what  predictors  are  related  to 
the  criteria  on  various  devices  are  correct.  However,  they  may 
not  appear  to  receive  support  because  of  statistical 
imperfections.  This  argument  will  be  developed  later. 

Boldovici's  point  that  inappropriate  analyses  are  often  used 
to  estimate  transfer  is  in  line  with  our  data  analysis  approach, 
where  we  opted  for  a  parsimonious  ANOVA  approach  to  estimate 
transfer.  We  had  hoped  to  use  raw  score  values  wherever  possible 
to  express  transfer  because  raw  scores  usually  carry  greater 
precision  of  meaning  (cf.  Gagne  et  al.,  1948).  However,  because 
of  unreliable  raw  scores  such  as  elevation  and  azimuth  aiming 
errors,  we  used  a  number  of  composite  measures.  An  irony  is  that 
while  composite  scores  ordinarily  possess  greater  validity,  their 
reliabilities  are  difficult  to  gauge.  A  composite  score  combines 
many  different  elemental  skills  which  may  themselves  be 
uncorrelated  with  each  other.  Although  composite  scores  tend  to 
"spread  out"  the  criterion  and  thus  permit  the  possibility  of 
greater  statistical  reliability,  their  use  opens  the  door  for 
potential  interpretation  problems  regarding  the  transfer  of 
specific  skills  between  devices  by  being  based  on  such  diverse 
elements . 
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The  secondary  purpose  of  this  study  was  to  determine  whether 
various  perceptual,  cognitive,  psychomotor,  and  motivational 
variables  would  predict  performance  on  three  tank  gunnery 
simulators,  of  varying  degrees  of  fidelity  to  the  Ml  tank.  We 
believed  that  more  valid  predictors  could  be  surfaced  because  of 
careful  selection  of  subjects,  rigorous  control  of  data 
collection,  and  focussed  emphasis  on  determining  the  reliability 
and  task-relatedness  of  all  measures. 

Our  premise  that  reliability  and  stability  of  measurement 
would  by  required  to  demonstrate  validity  adequately  was 
supported.  APTS  measures  stabilized  rapidly  and  exhibited  average 
reliabilities  above  .76.  VISTECH  measures  likewise  stabilized 
rapidly  and  were  extremely  reliable  (average  r=.71).  TOPGUN 
performance  measures,  with  the  exception  of  average  elevation 
error,  were  quite  stable  and  reliable.  This  finding  is  probably 
due  to  the  fact  that  engagements  are  very  easy,  and  there  is  a 
very  liberal  "kill  zone".  VIGS  performance,  on  the  other  hand, 
never  stabilized  over  four  trials.  Indeed,  retest  performances 
were  more  highly  related  on  the  first  two  trials  than  later  in 
practice,  and  there  was  very  little  carryover  between  the  two 
days  of  practice.  Partially  because  of  their  high  reliabilities, 
APTS  Code  Substitution,  Four-Choice  Reaction  Time,  and  Pattern 
Comparison;  FREQ1 ;  and  ASVAB  scores  proved  to  be  the  best  overall 
predictors  of  gunnery  performance  despite  generally  low  multiple 
correlations . 

However,  it  is  not  enough  to  use  reliability  as  the  sole 
explanation  for  significant  predictor-criterion  relationships 
because,  as  noted  before,  there  should  be  important  task-  and 
skill-related  underpinnings  to  these  findings.  In  this  study,  for 
example,  it  would  be  helpful  to  be  able  to  determine  the  extent 
to  which  trainable  skills  and  tasks,  as  defined  by  Hoffman  and 
Morrison  (1988,  see  Appendices  A,B,C,D),  transferred  across 
devices.  However,  it  was  not  possible  to  break  down  gunnery 
activities  into  broad  categories  (such  as  PREOPS  checks,  PREFIRE 
checks,  acquiring  targets,  etc.  )  within  the  global  scope  of  the 
performance  measures  used  in  this  study.  This  fact  also  precluded 
an  examination  of  fidelity  issues  inherent  in  training  system 
design  (cf..  Hays  &  Singer,  1989)  which  would  also  suggest  an 
optimal  VIGS,  TOPGUN,  COFT  mix. 

What  is  apparent  from  this  study,  as  with  those  that  have 
gone  before  (e.g.,  Graham,  1986),  is  that  predictive  validities 
of  both  ability  and  nonability  tests  as  well  as  devices 
themselves  are  attenuated  due  to  criterion  unreliability.  For 
example,  applying  the  correction  for  attenuation  formula 
(Spearman,  1904)  to  the  significant  .43  predictive  validity 
coefficient  between  nonpreferred  tapping  (reliability  =  .76)  and 
VIGS  time  to  kill  (reliability  =  .78)  increases  the  true 
relationship  to  .83.  Applying  the  formula  to  the  nonsignificant 
.33  validity  coefficient  between  contrast  sensitivity  FREQ1  (.51) 
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and  the  TOPGUN  performance  score,  which  shows  moderately  high 
reliability  (.43),  increases  the  validity  value  to  .47.  Also, 
applying  the  formula  to  the  .21  validity  coefficient  between  math 
processing  (reliability  =  .67)  and  VIGS  hit  percentage 
(reliability  =  .27)  increases  the  validity  to  .49. 

The  upper  limit  for  predictive  validity  is  the  geometric 
mean  of  the  criterion  reliability  and  the  predictor  reliability 
(Kendall  &  Stuart,  1977).  This  means  that  when  criteria  have  low 
reliabilities  (e.g.,  less  than  .55),  the  highest  possible 
relationship  between  a  predictor  and  a  criterion  is  less  than 
.74,  and  this  result  would  require  that  the  predictor  have  near 
perfect  reliability  and  that  the  predictor  and  criterion  totally 
overlap.  Also,  if  another  factor  (e.g.,  motivation,  cognitive 
ability,  or  perceptual  speed)  were  also  related  to  the  criterion 
in  a  unique  way  from  the  first  predictor,  the  best  possible  value 
for  r  =  .74  would  be  lowered  accordingly.  Based  on  rational 
expectations  of  reliabilities,  studies  have  been  conducted  with 
insufficient  sample  sizes  to  reveal  a  statistically  significant 
difference.  The  correlation  magnitude  which  is  required  for 
statistical  significance  for  a  sample  size  of  20,  for  example, 
would  need  to  be  .423  at  p  =  .05  or  .537  at  p  =  .01,  values  which 
are  rarely  attainable  in  studies  of  tank  gunnery  devices.  This 
notion  of  statistical  power  has  been  discussed  by  Morrison  (1988) 
who  analyzed  differences  between  group  means  in  tank  gunnery 
research  and  concluded  that  statistical  comparisons  of  company¬ 
sized  crews  (N  =  14)  are  relatively  insensitive  to  mean 
differences  in  speed  and  accuracy  of  performance. 

One  of  the  major  reasons  that  we  found  significant  transfer 
across  devices  in  this  study  was  because  repeated-measures  were 
used.  Repeated  testing  serves  to  increase  statistical  power, 
often  by  increasing  reliability.  In  this  study,  only  one 
administration  of  ICOFT  was  possible;  thus,  it  is  presumed  that 
ICOFT  performances  were  not  extremely  stable  or  reliable,  even 
though  transfer  was  demonstrated. 

In  summary,  our  results  indicate  that  there  is  evidence  for 
positive  skill  transfer  between  TOPGUN,  VIGS,  and  COFT  training 
devices.  The  statistical  significance  of  predictive  validities 
and  transfer  between  both  outside  predictors  and  devices  is  a 
function  of  time-on-task  and  measurement  reliability.  As  future 
research  incorporates  the  necessity  to  increase  performance 
stability  through  sufficient  practice  on  devices  and  to  improve 
measurement  reliability  through  careful  attention  to  sources  of 
measurement  error,  so  too  will  it  become  possible  to  identify  the 
critical  tank  gunnery  skills  that  enhance  gunner  selection  and 
training . 
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APPENDIX  A 


Breakdown  of  TOPGUN  Activities  and  Evaluation  of 

Trainability* 


BROAD  CATEGORY 

1 .  PREOPS  CHECKS 

2.  PREFIRE  CHECKS 

3.  ACQUIRE  TARGETS 


4.  ENGAGE  SINGLE  TARGETS 
WITH  MAIN  GUN 


5.  ADJUST  FIRE 


ACTIVITIES  TRAINABLE 


Check  Power  Control  Handles  (YES) 

Report  Weapon  Status  (YES) 

Receive  TC  Briefing  (YES) 

Select  GPS/TIS  Magnification 
( YES ) 

Search  on  Gun  Axis  With  GPS  (YES) 
Alternate  Using  GPS  with  TIS 
( NO )  + 

Execute  Search  Techniques  (NO) 
Search  on  Gun  Axis  with  TIS  (YES) 
Detect  Targets/Signatures/ 
Obstacles  (NO) 

Locate  Targets  (YES) 

Announce  GUNNER  REPORT  (NO) 
Estimate  Range  to  Evaluate  LRF 
Return  (YES) 

Thermal  Magnification  (YES) 
Thermal  Mode:  ON  (YES) 

Evaluate  Range  Display  (YES) 

Check  Ready  to  Fire  Faults  (NO) 
Listen  for  "UP"  (YES) 

Listen  for  "FIRE"  (N0)+ 

LRF:  Arm  Last  RTN  (N0)+ 

GPS : 3x  (YES) 

Gun  Select :MAIN  (NO) 

Sight  Through  GPS  (NO) 

Grasp  Palm  Switches  (YES) 

Announce  "IDENTIFIED"  (YES) 

Switch  GPS  to  1  Ox  (YES) 

Lay  on  Target  Center  of  Mass 
(YES) 

Track  Moving  Target  (YES) 

Depress  Lase  Button  (YES) 

Recover  Sight  Picture  (N0)+ 
Observe/Announce  Round  Effect 
(YES) 

Announce  REENGAGING  (YES) 
Release/Reengage  Palm  Switches 
(YES ) 

Observe/Announce  Deflection  and 
Range  Error  (YES) 
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6.  ENGAGE  MULTIPLE  TARGETS 
WITH  THE  MAIN  GUN 


Adjust  1  mil  Deflection  (YES) 
Adjust  200  Meters  Range  (YES) 

If  First  Target  not  Destroyed, 
Adjust  Fire  (YES) 


7.  ENGAGE  TARGETS  USING  Set  LRF : SAFE  (YES) 

DEGRADED  GUNNERY  TECHNIQUES  Set  Gun  Select: MAIN  (NO) 

Sight  Through  GAS  (NO) 

Grasp  Palm  Switches  (YES) 
Announce  IDENTIFIED  (YES) 
Lay  Announced  Range  Line  on 
Target  (NO)+ 

Lead  Moving  Target  (YES) 
Listen  for  FIRE  (NO)+ 
Announce  ON  THE  WAY  (YES) 
Squeeze  Trigger  (YES) 
Continue  Tracking  (YES) 

*  From  Hoffman  and  Morrison  (1987;  Appendix  G-2-1 ) 

+  Items  which  have  since  been  changed/improved . 
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APPENDIX  B 


Breakdown  of  VIGS  Gunnery  Activities  and  Evaluation  of 

Trainability* 


BROAD  CATEGORY 

1 .  PREOPS  CHECKS 

2.  PREFIRE  CHECKS 

3.  ACQUIRE  TARGETS 

4.  ENGAGE  SINGLE  TARGETS  WITH 
MAIN  GUN 


5.  ADJUST  FIRE 


ACTIVITIES  TRAINABLE 

Perform  TIS  Check  (NO) 

Check  Power  Control  Handles  (YES) 

Report  Weapon  Status  (YES) 

Index  Battlecarry  Ammo  on  Ammo 
Select  Switch  (YES) 

Receive  TC  Briefing  (YES) 

Estimate  Range  to  Evaluate  LRF 
Return  (NO) 

LRF:  Arm  Last  Return  (N0)+ 

Gun  Select:  MAIN  (NO)+ 

Ammo  Select  as  Announced  (YES) 
Sight  Through  GPS  (YES) 

Grasp  Palm  Switches  (N0)+ 

Look  Through  GPS  (YES) 

Announce  IDENTIFIED  (YES) 

Lay  on  Target  Center  of  Mass 
(YES) 

Track  Moving  Target  (N0)+ 

Depress  Lase  Button  (N0)+ 

Squeeze  Trigger  (YES) 

Continue  Tracking  (N0)+ 

Thermal  Mode: ON  (YES) 

Evaluate  Range  Display  (YES) 
FLTR/CLEAR/SHUTTR :  SHUTTR  (YES) 
Check  Ready  to  Fire  and  Faults 
(NO) 

Sensitivity,  Contrast,  and  Focus 
for  Best  Image  (YES) 

Make  Control  Lay  (YES) 

Listen  for  UP  (N0)+ 

Listen  for  FIRE  (N0)+ 

Polarity  Switch  (N0)+ 

Announce  ON  THE  WAY  (YES) 

Recover  Sight  Picture  (N0)  + 
Observe/Announce  Round  Effects 
( NO )  + 

Announce  REENGAGING  (YES) 
Release/Reengage  Palm  Switches 
( NO )  + 

Announce  Deflection  and  Range 
Error  (Yes) 
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Adjust  1  mil  Deflection  (NO) 
Adjust  200  meters  range  (NO) 

LRF: Arm  LST  RTN  (NO)+ 

GPS : 3x  (NO) 

Gun  Select : COAX  (NO)  + 

Grasp  Palm  Switches  (NO)+ 
Announce  IDENTIFIED  (YES) 

Lay  on  Center  of  Mass  (YES) 
Depress  Lase  Button  (NO)+ 
Evaluate  Range  Display  (YES) 
Listen  For  FIRE  (YES) 

Announce  ON  THE  WAY  (YES) 

Fire  20-30  Round  Burst  (YES) 
Adjust  Fire  (YES) 

7.  ENGAGE  MULTIPLE  TARGETS  Adjust  Fire  (NO)+ 

WITH  MAIN  GUN 

8.  ENGAGE  TARGETS  USING  LRF: Safe  (NO)+ 

DEGRADED  GUNNERY  TECHNIQUES  Gun  Select: MAIN  (NO)+ 

Ammo  Select  (YES) 

Reengage  Target  Using  Precision 
Gunnery  Without  Lasing  To 
Target  (NO) 

9.  ASSESS  RESULTS  OF  ENGAGEMENT  Index  Battlecarry  Ammo  (NO) 

Announce  IDENTIFIED  (YES) 

*  From  Hoffman  and  Morrison  (1987;  Appendix  G-1-1) 

+  Items  which  have  since  been  changed  or  improved. 


6.  ENGAGE  SINGLE  TARGETS 
WITH  MAIN  GUN 
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APPENDIX  C 


Task  analysis  of  trainable  behaviors  on  TOPGUN,  VIGS,  COFT. 


Device  Conditions: 


Parameters 

Device 

Conditions  VIGS  TOPGUN 

UCOFT 

Target 

Type 

a.  Tank 

YES 

YES 

YES 

b.  pers.  carrier 

YES 

NO 

YES 

c.  helicopter 

YES 

NO 

YES 

d.  bunkers 

NO 

NO 

NO 

e.  antitank 

NO 

NO 

NO 

f .  truck 

YES 

NO 

YES 

g.  troops 

YES 

NO 

YES 

h.  aircraft 

NO 

NO 

NO 

Target 

Movement 

a.  sta.  front 

YES 

YES 

YES 

b.  sta.  flank 

YES 

YES 

YES 

c.  sta.  oblique 

YES 

YES 

YES 

d.  mov.  flank 

YES 

YES 

YES 

e.  mov.  oblique 

YES 

YES 

YES 

f.  mov.  zig-zag 

YES 

YES 

YES 

g.  mov.  approach 

YES 

YES 

YES 

h.  mov.  retreating 

NO 

YES 

YES 

Target 

Array 

a.  single  targets 

YES 

YES 

YES 

b.  multiple  targets 

YES 

YES 

YES 

c.  both  sing.  &  mult. 

NO 

YES 

NO 

Target 

Range 

a.  <  900  meters 

YES 

NO 

YES 

b.  900-1800  meters 

YES 

YES 

YES 

c.  >  1800  meters 

YES 

YES 

YES 

Ident . 

of  targets 

a.  threat 

YES 

YES 

YES 

b.  friendly 

NO 

NO 

YES 

c.  mixed 

NO 

NO 

YES 

Supply 

shortages 

a.  none 

YES 

YES 

YES 

simulated? 

b.  ammo 

YES 

YES 

NO 

c.  fuel 

NO 

NO 

NO 

d.  food 

NO 

NO 

NO 

Mission  type 

a.  offense  (moving) 

YES 

NO 

YES 

b.  defense  (stationary) 

YES 

YES 

NO 
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Gunnery  Behavior  Represented 

Per  Device: 

Device 

Activity 

Options 

VIGS 

TOPGUN 

COFT 

Prepare  Operations 

a. 

prepare  offensive 

NO 

NO 

YES 

(PREOPS) 

b. 

prepare  defensive 

NO 

NO 

NO 

Prepare-to-f ire 

a . 

prepare  offensive 

YES 

NO 

YES 

(PREFIRE) 

b. 

prepare  defensive 

NO 

NO 

NO 

Acquire  Targets 

a. 

search  for  targets 

YES 

YES 

YES 

1.  open  hatch  (day) 

NO 

NO 

NO 

2.  closed  hatch 

60% 

100% 

100% 

3.  night  search 

60% 

100% 

100% 

b. 

detect/ locate/ I .D. 

NO 

YES 

YES 

c. 

evaluate  situation 

N/A 

N/A 

30% 

Engage  single  target 

a . 

offensive  engage 

YES 

NO 

YES 

with  main  gun 

b. 

defensive  engage 

YES 

YES 

YES 

c . 

thermal  sighting 

YES 

YES 

YES 

d. 

magnif.  choice 

YES 

YES 

YES 

Adjust  fire 

a . 

use  reengagement 
procedures 

NO 

NO 

YES 

b. 

use  standard 
adjustment 

YES 

YES 

YES 

c. 

use  T.C.  adjust 

N/A 

N/A 

YES 

Engage  single  target 
with  COAX 

YES 

NO 

YES 

Engage  mult,  targets 
with  main  gun 

YES 

YES 

YES 

Engage  targets  with 
cal.  50 

N/A 

N/A 

YES 

Engage  targets  under 

a . 

battlesight  guns 

YES 

YES 

YES 

degraded  conditions 

b. 

ineffective  LRF 

YES 

YES 

YES 

c. 

multiple  returns 
from  LRF 

NO 

YES 

YES 

d. 

no  range  display 

NO 

NO 

50% 

e . 

crosswind  sensor 
failure 

NO 

NO 

50% 

f . 

cant  sensor  fail 

NO 

NO 

50% 

g- 

lead  angle  sensor 
failure 

NO 

NO 

NO 

h. 

GPS  failure 

YES 

YES 

YES 

i . 

GPS/TIS  failure 

NO 

NO 

YES 

3  • 

stabilization 
system  failure 

NO 

NO 

YES 

k . 

loss  of  turret  power  NO 

NO 

YES 
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Engage  from  T.C. 
position 

N/A 

N/A 

YES 

Assess  Results  of 

Engagement 

NO 

NO 

50% 
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APPENDIX  D 


Overall  Rankings  of  Task  Transferability 
by  Broad  Category 


TOPGUN  to  UCOFT 


VIGS  to  UCOFT 


1  Engage  Multiple  Targets 
with  main  gun. 

2  Engage  Targets  using  TIS 

3  Engage  Single  Target  from 
Defense  Using  Precision  Gunnery 

4  PREOPS 

5  PREFIRE 

5  Adjust  Fire 

5  Engage  Targets  using  GAS 

6  Acquire  Targets 


1  Engage  Multiple  Targets 
with  main  gun 

2  PREFIRE 

3  Engage  Targets  using 
Battlesight  Gunnery 

4  Assess  Engagement 
Results 

4  Engage  Single  Target  v/ 
COAX 

4  Adjust  Fire 

5  Engage  Targets  using  TIS 

6  Acquire  Targets 

7  PREOPS 


♦Data  from  Hoffman  and  Morrison  (1987,  p-  53-59) 


Listing  of  Gunnery  Behaviors  that  are  Untrainable 
by  Broad  Category 


TOPGUN 

Assess  Immediate  Results  of 
Single  Engagement 

Engage  Targets  from  TC 
Position 

Engage  Targets  in  Manual  Mode 


Engage  Targets  in  Emergency 
Mode 

Engage  Targets  Given  Fire 
Control  System  Failure 

Engage  Targets  Using 
Battlesight  Gunnery 

Engage  Targets  Using  Cal.  50 

Engage  Single  Targets  with  COAX 


VIGS 

Engage  Single  Target  From 

Offense  Using  Precision  Gunnery 

Engage  Targets  with  the  Cal.  50 

Engage  Targets  Given  Fire  Control 
System  Failure 

Engage  Targets  Using  GAS 
Engage  Targets  in  Emergency  Mode 
Engage  Targets  in  Manual  Mode 
Engage  Targets  from  TC  Position 
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APPENDIX  E 


Sign-up  Sheet  for  Tank  Gunnery  Transfer  Experiment 

ATTENTION  !! 


Students  are  needed  to  participate  in  an  experiment  which 
will  investigate  the  transfer  of  tank  gunnery  skills  trained  on 
two  part-  task  gunnery  trainers  to  a-whole-task  gunnery  trainer. 

Students,  in  order  to  be  included,  must  fulfill  the 
following  requirements: 


1)  Must  be  of  the  male  gender. 

2)  Must  be  a  UCF  student. 


3)  Must  be  able  to  participate  for  a  total  of  16  hours,  broken 
up  as  follows: 

a.  First,  four  hours  will  be  required  the  first  week,  in 
which  testing  will  be  administered. 

b.  Second,  students  will  be  required  to  participate  for  2 
hours  per  day  for  4  consecutive  days  during  the  second 
week . 


c.  Third,  students  must  be  able  to  travel  to  Daytona  for 
one  day  during  the  third  week,  for  3  hours  of  off-site 
training.  (Travel  time  not  included) 

4)  The  ideal  subject  will  be  of  Freshman  or  Sophomore  standing. 


Students  may  be  placed  in  one  of  two  experimental 
conditions:  either  a  full  experimental  condition,  in  which  "a", 
"b",  and  "c"  of  number  3  are  fulfilled;  or  a  control  condition, 
in  which  only  "a"  and  "c"  are  fulfilled. 

At  the  termination  of  the  experiment,  students  will  be  paid 
at  the  rate  of  approximately  $5.00  per  hour  for  their 
participation.  Therefore,  students  who  are  in  the  experimental 
condition,  putting  in  approximately  20  hours  of  work,  will  be 
paid  $100.00  for  their  services;  and  students  in  the  control 
condition,  who  fulfill  only  steps  "a”  and  "c"  of  number  3,  above, 
will  be  paid  $50.00  for  their  participation  via  OPS  contract. 
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APPENDIX  F 


Subject  Background  Information 

The  purpose  of  this  questionnaire  is  to  collect  background 
information  on  soldiers  participating  in  the  IST/ARI  transfer  of 
training  research.  This  information  will  be  used  strictly  for 
research  purposes  only.  Please  complete  each  item  to  the  best  of 
your  ability.  Write  "N/A"  for  each  item  you  cannot  answer. 


1.  Name: _ _ _ 

Last  Eirst  M.I. 

2.  Social  Security  Number: _ - _ - _ 


3.  Date  of  Birth: _ / _ / 


4.  Present  grade  classification  (Junior,  Senior, 
etc.  ) 


5.  Length  of  time  spent  in  ROTC 


6.  Of  what  branch  ROTC  are  you  a  member  (Air  Force  or 
Army ) _ 


7.  How  often  do  you  play  video  games  (circle  one)? 

A.  less  than  once  per  week 

B.  once  per  week 

C.  2-4  times  a  week 

D.  greater  than  4  times/week 
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APPENDIX  G 


Informed  Consent  Form  for  The  Use  of 
Surrogate  Measures  in  Tank  Gunnery  Transfer 

In  this  experiment,  we  are  going  to  measure  the  degree  of 
transfer  that  occurs  between  two  part-task  gunnery  simulators  and  a 
full-fidelity  tank  gunnery  trainer.  In  order  to  do  this  we  will  be 
administering  four  predictor  tests  to  determine  factors  which  might 
influence  simulator  performance.  Your  participation  will  be  needed  for 
approximately  16  hours,  allocated  as  follows:  1)  Four  hours  the  first 
week,  at  a  preassigned  time;  2)  Eight  hours  the  second  week  (2 
hours/day  for  4  consecutive  days).  Control  subjects  will  not  receive 
this  training;  3)  Four  hours  the  third  week,  at  a  preassigned  time. 

The  experiment  will  be  carried  out  in  the  Human  Factors 
Laboratory  of  the  Institute  for  Simulation  and  Training  by  Dr.  Janet 
Turnage,  Department  of  Psychology  (275-2910)  and  her  associates. 

On  some  of  the  tests  and  simulator  tasks  you  will  notice  that 
your  performance  will  improve.  This  is  due  to  learning  and  it  is  one 
of  the  issues  we  are  studying  in  this  experiment.  As  with  all  test 
batteries  (a  test  composed  of  several  individual  tests  that  measure 
different  abilities),  and  simulated  tasks,  there  will  be  items  and 
tasks  which  are  easy  and  those  which  are  difficult.  No  one  is  expected 
to  be  able  to  perform  perfectly,  but  we  ask  that  you  perform  as 
accurately  and  as  quickly  as  possible.  Therefore,  please  do  not  serve 
as  a  subject  any  time  that  you  are  not  in  your  usual  state  of  fitness, 
mentally  and  physically.  During  the  period  of  the  experiment  if  you  go 
on  medication,  experience  heavy  pressure  or  stress,  end  up  not  getting 
a  good  night's  sleep,  or  take  more  than  one  or  two  cups  of  coffee  or 
alcoholic  beverages  in  the  last  24  hours,  we  ask  that  you  alert  the 
experimenter,  or  reschedule  your  session. 

All  data  will  be  encoded  numerically  to  ensure  every  subject's 
confidentiality  and  anonymity.  The  coded  data  will  be  examined  only  by 
the  members  of  the  research  team,  and  you  are  assured  that  the  data 
will  not  be  used  for  any  purpose  other  than  the  scientific  goals  of 
this  experiment.  Your  data  will  be  stored  on  both  diskette  and  paper, 
so  that  no  one  except  the  experimenters  will  have  access  to  your 
scores.  Participation  in  this  study  is  voluntary,  ar.  I  .efusal  to 
participate  will  not  result  in  any  penalty  or  loss  of  benefits  to 
which  one  is  otherwise  entitled.  Anyone  who  wishes  to  withdraw  from 
participation  may  do  so  at  any  time.  As  a  participant  in  this  study 
you  will  receive  $5.00  per  hour.  Therefore,  control  subjects  will  be 
paid  $50.00,  experimental  subjects  will  be  paid  $100.00,  and  subjects 
who  withdraw  will  be  paid  on  a  pro-rata  basis.  Thank  you  for  your 
participation  in  this  experiment. 


1 1 _ 

Your  Name 

_ r 

Today's  Date 


_  have  read  this  Infoimed  Consent  Form  on 

and  fully  understand  the  information  above. 

S.S. 
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APPENDIX  H 


Target  Sequences  for  Each  Simulator;  Tank  Gunnery  Transfer  Study 


TOPGUN 

Targets 

1 ,  2 ,  3 : 

Stationary,  Single,  Primary  Sights 

Targets 

4,  5: 

Stationary,  Single,  Thermal  Sights 

Targets 

6,  7: 

Moving,  Single,  Primary  Sights 

Targets 

8,  9,  10: 

Moving,  Single,  Thermal  Sights 

Targets 

11,  12,  13, 
14,  15,  16: 

Multiple  (stationary  and  moving  mix). 
Primary  Sights 

Targets 

17,  18,  19, 
20: 

Multiple  (stationary  and  moving  mix). 
Thermal  Sights 

Targets 

21,  22,  23, 

24: 

Stationary,  Single,  Secondary  Sights 

Targets 

25,  26,  27, 

28: 

Moving,  Single,  Secondary  Sights 

Targets 

29,  30,  31, 
33,  34,  35, 

32, 

36: 

Multiple  (stationary  and  moving  mix). 
Secondary  Sights 

VIGS 

Targets 

1  ,  2,  3,  5, 

6 : 

Stationary,  Single,  Primary  Sights 

Target 

4: 

Stationary,  Single,  Thermal  Sights 

Target 

8: 

Moving,  Single,  Primary  Sights 

Targets 

7,  9: 

Moving,  Single,  Thermal  Sights 

Targets 

10,  11,  14, 
22,  23,  26 
30,  31: 

15, 

,  27, 

Multiple  (moving  and  stationary  mix). 
Primary  Sights 

Targets 

12,  13,  16, 
18,  19,  20 
24,  25,  28 

17, 

,  21, 

,  29: 

Multiple  (moving  and  stationary  mix), 
Thermal  Sights 

Target 

32: 

Stationary,  Single,  Secondary  Sights 

Targets 

33,  34,  35: 

Moving,  Single,  Secondary  Sights 

Targets 

36,  37,  38, 

39, 

Multiple  (moving  and  stationary  mix). 

40,  41:  Secondary  Sights 
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ICOFT 


31211  Targets: 
31411  Targets : 
32412  Targets: 
33211  Targets: 
33411  Targets : 
32261  Targets: 


Stationary,  Single,  Primary  Sights 
Moving,  Single,  Primary  Sights 
Moving,  Single,  Thermal  Sights 
Stationary,  Multiple,  Primary  Sights 
Moving,  Multiple,  Primary  Sights 
Stationary,  Single,  Secondary  Sights 
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APPENDIX  I 


Instructions  for  Subjects 
(Skills  Transfer  of  Training  in  Tank  Gunnery 
Simulation  Systems) 

Approx. 

Time 

1.  On  the  first  day  that. you  report  to  1ST  for  the 
experiment  you  will  be  asked  to  fill  out  certain  forms 
for  administrative  purposes  and  take  a  colorblind 
screening  test. 


1  min . 
1  min . 

1  min . 


1  min . 


a.  Informed  Consent-  please  read  and  sign,  fill  in 
SS#. 

b.  OPS  Contract-  read  and  sign;  you  will  sign  again 
at  completion  of  experiment  and  will  receive 
payment  approximately  3-4  weeks  afterward. 

c.  Background  Information-  please  fill  out 
completely,  then  write  on  back  of  sheet:  Name, 

SSI,  address,  (to  be  later  filled  out  on  OPS 
contract ) . 

d.  Colorblind  Test-  view  the  plate  through 
stereoscope,  adjusting  the  plate  forward  and 
backward  until  in  focus;  the  numbers  which  you  see 
in  the  circles  labelled  A,  B,  C,  and  D: 

A _ B _  C  D 


2.  Next  you  will  be  given  a  series  of  tests  to 
measure  various  sensory,  perceptual,  cognitive, 
psychomotor,  and  motivational  facets  of  individuals. 
The  order  of  testing  and  a  brief  description  of  the 
tests  follows: 


3  mins. 


1  5-25 
mins . 


a.  VISTECH-  Stand  10  ft.  from  the  contrast 
sensitivity  plates  and  ,  with  both  eyes  open,  tell 
the  experimenter  whether  the  lines  within  each  of 
the  circles  go  to  the  left,  right,  straight  up,  or 
are  nonexistent. 

b.  Automated  Performance  Test  System-  Turn  the 
minicomputer  on  at  right  side  of  machine  and  wait 
until  the  computer  asks  whether  you  are  a 
"qualified  user"  -  if  this  is  your  first  trial, 
type  "N"  and  enter  your  SS#.  All  following  trials, 
type  "Y",  enter  SS#,  and  proceed  -  the  first  trial 
is  a  practice  session  in  which  you  will  be  given 
instructions  for  each  test  and  be  allowed  to 
practice  for  a  short  period.  If  you  miss  more  than 
40%  of  the  items  or  get  more  than  5  incorrect  in  a 
row,  the  computer  will  stop  and  tell  you  to  see 
the  experimenter.  If  the  experimenter  is  not 
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1  hr .  + 

15  mins. 
15  mins. 

1  0-15 
mins . 

15  mins. 

3  mins. 


available,  press  <Ctrl-R>  and  you  will  start  that 
particular  test  over  again.  Be  sure  to  read  the 
instructions  carefully  and  be  especially  careful 
that  you  are  pressing  the  correct  keys  for  your 
responses.  You  will  receive  feedback  on  the  first 
trial,  but  none  on  the  three  test  trials  to 
follow. 

c.  ASVAB-  This  paper  and-pencil  test  will  take  a 
total  of  1  hour  to  take.  Turn  the  tape  recorder 
and  follow  the  instructions.  If  you  need  help  at 
any  time,  find  the  experimenter  (usually  in  TOPGUN 
and  VIGS  area)  for  assistance. 

d.  BREAK-  You  may  go  to  the  cafeteria  down  the  hall 
(to  left);  rest  rooms  are  also  there. 

e.  APTS-  This  will  be  your  second  APTS  trial;  enter 
your  SS#  and  proceed,  following  computer-generated 
instructions . 

f.  Work  and  Family  Orientation  Questionnaire-  Follow 
the  written  instructions  and  respond  to  items 
1-23. 

g.  APTS-  This  is  your  third  and  last  administration; 
follow  instructions  as  before. 

h.  VISTECH-  This  is  the  second  administration  of  the 
contrast  sensitivity  plates;  follow  instructions 
as  before. 


3.  Check  with  experimenter  to  verify  the  time  and 
place  for  your  next  experimental  session  before 
leaving. 


THANK  YOU  FOR  YOUR  PARTICIPATION!! 
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APPENDIX  J 


TOPGUN  Instructions 

Hi!  My  name  is  _  with  the  Institute  for 

Simulation  and  Training  here  at  UCF.  Today  you  will  train  for 
approximately  2  hours  on  the  TOPGUN  tank  gunnery  trainer. 

Please  seat  yourself  inside  the  trainer.  TOPGUN  is  an  arcade-type 
trainer  which  has  few  knobs  to  manipulate.  With  TOPGUN,  soldiers 
can  train  or  sharpen  their  gunnery  skills  in  a  competitive 
environment. 

In  front  of  you,  you  will  see  two  connected  handles  ( Cadillacs). 
These  Cadillacs  move  the  gun  tube  up,  down,  and  side  to  side.  To 
move  the  reticle  (crosshairs)  side  to  side,  turn  the  handle  like 
a  steering  wheel.  To  move  the  reticle  up  or  down,  twist  the 
handles  accordingly,  (demonstrate). 

You  will  also  notice  two  sets  of  buttons.  The  first  set  of 
buttons,  located  near  the  top  and  inner  portions  of  the  handles, 
controls  the  laser  rangefinder  mechanism.  This  gives  you  a  "lock" 
on  the  target,  as  well  as  computing  the  target’s  range  which  is 
shown  on  the  screen.  The  second  set  of  buttons,  located  near  the 
index  fingers'  position,  are  the  fire  buttons.  Finally,  in  order 
for  any  buttons  or  movements  to  work,  THE  PALM  LEVERS  ON  THE 
FRONT  OF  THE  CADILLAC  HANDLES  MUST  BE  ENGAGED.'!! 

Therefore,  when  engaging  a  target,  the  sequence  of  activities  is 
as  follows: 

1.  Squeeze  palm  levers  and  hold  them  down. 

*  2.  Manipulate  Cadillacs  to  bring  reticle  to  desired  position 
( on  target ) . 

When  manipulating  the  Cadillacs,  be  sure  that  the  last 
movement  of  the  reticle  onto  the  target  is  in  an  upward  motion. 
Also,  when  reengaging  the  target,  be  sure  to  "dump  lead"  by 
disengaging  and  reengaging  the  palm  levers!  (demonstrate) 

3.  Activate  Laser  Rangefinder. 

4.  While  still  tracking  the  target,  press  the  fire  button. 

5.  Assess  results  and  reengage  target  if  necessary. 

6.  Disengage  palm  levers. 
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When  playing  TOPGUN,  an  automated  tank  commander  will  move  you 
close  to  the  target  to  be  engaged.  He  will  then  give  you  the 
order  to  fire.  When  shooting  more  than  once,  you  must  wait  for 
the  "UP"  signal  before  firing.  This  indicates  that  a  shell  is 
chambered  and  ready  to  fire.  Firing  before  the  "UP"  or  "FIRE" 
commands  will  result  in  penalties  being  assessed  against  your 
score. 

There  are  three  modes  of  operation  that  you  will  use  in  the 
following  engagements.  These  are  GPS  (Gunner's  Primary  Sight), 

GAS  (Gunner's  Auxiliary  Sight),  or  TIS  (Thermal  Imaging  System). 
At  the  start  of  each  engagement,  I  will  tell  you  which  mode  you 
will  operate  in  and  it  will  be  your  responsibility  to  switch 
manually  x.o  that  particular  mode.  A  toggle  switch  to  your  left 
enables  you  to  operate  in  GPS  or  GAS  mode.  The  "Sight  Select" 
switch  must  be  set  to  "PRIMARY"  for  GPS  mode  and  "SECONDARY"  for 
GAS  mode.  For  TIS,  the  "Sight  Select"  switch  must  be  set  to 
"PRIMARY"  and  the  toggle  switch  to  your  right  (thermal  mode)  must 
be  set  to  "ON" . 

When  the  automated  tank  commander  announces  a  target  and  slews 
you  toward  it,  it  will  be  your  responsibility  to  switch  from 
Magnification  "3x"  to  Magnification  "I0x".  After  confronting  the 
target,  the  commander  will  say  "cease  fire".  At  this  point,  you 
should  switch  back  to  "3x",  in  preparation  for  the  next  target. 

Are  there  any  questions  regarding  these  instructions? 
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APPENDIX  K 


VIGS  Instructions 

Hi!  My  name  is  _  with  the  Institute  for 

Simulation  and  Training  here  at  UCF.  Today  you  will  train  for 
approximately  2  hours  on  the  VIGS  tank  gunnery  trainer. 

Please  have  a  seat  in  front  of  the  trainer.  VIGS  is  a  trainer 
which  utilizes  videodisk  technology  to  present  30-45  second 
engagements  to  the  trainee.  There  are  more  switches  and  knobs 
that  need  to  be  manipulated  than  on  TOPGUN.  In  front  of  you,  you 
will  see  two  connected  handles  ( Cadillacs).  These  Cadillacs  move 
the  gun  tube  up,  down,  and  side  to  side.  To  move  the  reticle 
(crosshairs)  side  to  side,  turn  the  handle  like  a  steering  wheel. 
To  move  the  reticle  up  or  down,  twist  the  handles  accordingly, 
(demonstrate ) 

You  will  also  notice  two  sets  of  buttons.  The  first  set  of 
buttons,  located  near  the  top  and  inner  portions  of  the  handles, 
controls  the  laser  rangefinder  mechanism.  This  gives  you  a  "lock" 
on  the  target,  as  well  as  computing  the  target's  range  which  is 
shown  on  the  screen.  The  second  set  of  buttons,  located  near  the 
index  fingers'  position,  are  the  fire  buttons.  Finally,  in  order 
for  any  buttons  or  movements  to  work,  THE  PALM  LEVERS  ON  THE 
FRONT  OF  THE  CADILLAC  HANDLES  MUST  BE  ENGAGED!!! 

Therefore,  when  engaging  a  target,  the  sequence  of  activities  is 
as  follows: 

1 .  Squeeze  palm  levers  and  hold  them  down. 

*2.  Manipulate  Cadillacs  to  bring  reticle  to  desired  position 
(on  target). 

When  manipulating  the  Cadillacs,  be  sure  that  the  last 
movement  of  the  reticle  onto  the  target  is  in  an  upward  motion! 
Also,  when  reengaging  the  target,  be  sure  to  "dump  lead"  by 
disengaging  and  reengaging  the  palm  levers!  (demonstrate) 

3.  Activate  Laser  Rangefinder. 

4.  While  still  tracking  the  target,  press  the  fire  button. 

5.  Assess  results  and  reengage  target  if  necessary. 

6.  Disengage  palm  levers. 

Now,  look  at  the  panel  in  front  of  you.  you  will  notice  a 
screen  embedded  within  the  panel.  When  an  engagement  begins,  you 
must  look  at  the  screen  to  determine  the  type  of  mission  which  is 
forthcoming.  There  are  two  possibilities: 

1.  "Initiating  Mission".  In  this  case,  the  shutter  switch 
needs  to  be  set  on  "clear"  and  the  thermal  mode  switch 
must  be  on  "standby". 
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2.  "Initiating  Thermal  Mission”.  In  this  case,  the  shutter 
switch  must  be  turned  clockwise  to  "SHUTTR”.  Also,  the 
thermal  mode  switch  must  be  set  to  "ON”. 

After  proper  setting  of  the  shutter  and  thermal  mode 
switches,  the  engagement  will  begin.  An  automated  tank  commander 
will  slew  you  to  the  target,  while  instructing  you  as  to  the  type 
of  ammunition  required  to  be  used  (i*e.,  "GUNNER,  SABOT"  or 
"GUNNER,  HEAT"). 

After  hearing  this,  you  must  manipulate  the  switch  above  the 
screen  (reticle  selection  switch)  and  the  ammo  selection  switch 
accordingly. 

At  this  point,  you  should  place  the  reticle  on  the  target, 
press  the  laser  rangefinder  button,  and  fire,  continuously 
tracking. 

Are  there  any  questions  regarding  these  instructions? 
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APPENDIX  L 


GAS  Sighting  Instructions 


The  following  few  engagements  will  use  the  manual  reticle 
you  see  on  the  screen.  When  the  automated  tank  commander  slews 
you  to  the  target,  he  will  announce  a  range  (i.e.,  "one  four 
hundred,  one  two  hundred,  etc.).  Upon  hearing  that  range,  place 
the  reticle  line  corresponding  to  it  on  the  target  ("14" 
corresponds  to  "one  four  hundred,  etc.).  Also,  apply  lead  if  the 
target  is  moving! 

Do  you  have  any  questions  regarding  these  instructions? 


0 


8 

12 

16 

20 

24 

28 
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APPENDIX  M 

Subject  Opinion  Questionnaire 

Subject  No. _ 

The  purpose  of  this  questionnaire  is  to  collect  subjects' 
opinions  about  the  devices  they  used: in  the  IST/ARI  transfer  of 
training  research.  This  information  will  be  used  strictly  for 
research  purposes  only.  Please  complete  each  question  to  the  best 
of  your  ability.  Write  "N/A"  for  each  item  you  cannot  answer. 

Part  One  --  TOPGUN 

The  following  survey  questions  pertain  only  to  the  TOPGUN 
trainer.  Please  indicate  how  much  you  agree  or  disagree  with  the 
following  statements.  Head  each  statement  carefully,  then  choree 
the  number  from  the  scale  below  that  matches  your  feelings  about 
the  statement.  If  you  have  other  opinions  regarding  TOPGUN  that 
are  not  covered  in  the  survey  please  elaborate  upon  these  in  the 
comments  section. 


1  2  3  4  5 

Strongly  Somewhat  Neither  Agree  Somewhat  Strongly 

Disagree  Disagree  nor  Disagree  Agree  Agree 

1  _  I  enjoyed  .raining  on  the  TOPGUN  device. 

2.  _  TOPGUN  helped  me  to  improve/ learn  tank  gunnery  skills. 

3.  _  If  I  could  see  the  target,  I  could  hit  it. 

4.  _  Most  of  the  target  engagements  were  too  difficult. 

5.  _  If  given  a  choice,  I  would  use  TOPGUN  to  train  on. 

6.  _  I  could  use  TOPGUN  without  any  instructor  assistance. 

7.  _  I  thought  TOPGUN  engagements  were  too  easy. 

8.  _  I  had  trouble  finding  targets  on  TOPGUN, 

9.  _  1  liked  the  "unity  window"  for  locating  targets. 

111. _  The  skills  trained  on  TOPGUN  were  the  same  as  on  ICOFT. 

11.  _  The  device  features  on  TOPGUN  (color  coding  of  targets, 

etc)  were  helpful  when  learning  to  hit  the  targets. 

12.  _  Prior  TOPGUN  training  helped  my  performance  on  ICOFT. 


COMMENTS: 
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Subject  No. 


Part  Two  —  VIGS 


The  following  survey  questions  pertain  only  to  the  VIGS 
trainer.  Please  indicate  how  much  you  agree  or  disagree  with  the 
following  statements.  Read  each  statement  carefully,  then  choose 
the  number  from  the  scale  below  that  matches  your  feelings  about 
the  statement.  If  you  have  other  opinions  concerning  VIGS,  please 
write  them  in  the  comments  section.  - 


1 


2 


3 


4 


5 


Strongly 

Disagree 


Somewhat 

Disagree 


Neither  Agree 
nor  Disagree 


Somewhat  Strongly 
Agree  Agree 


I  enjoyed  training  on  the  VIGS  device. 

VIGS  helped  me  to  learn/improve  my  gunnery  skills. 

If  I  could  see  the  target,  I  could  hit  it. 

Most  of  the  engagements  were  too  difficult. 

If  given  a  choice,  I  would  choose  the  VIGS  to  train  on. 
I  could  use  VIGS  without  any  instructor  assistance. 

I  thought  the  VIGS  engagements  were  too  easy. 

I  had  trouble  finding  targets  on  VIGS. 

I  was  confused  by  the  adjustments  required  by  VIGS. 

The  skills  trained  on  VIGS  were  the  same  as  on  ICOFT. 
The  voice  on  VIGS  was  difficult  to  understand. 

Prior  VIGS  training  helped  my  performance  on  ICOFT. 


COMMENTS: 
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Mean  Performance  Measures  Across  Trials  for  TOPGUN  and  VIGS 


Mean  Elevation  and  Azimuth  Error  Scores 
tor  TOPGUN  and  VIGS-First  Groups  Across 
Trials  tor  TOPGUN 


VIGS-First 

Azimuth 

TGUN-First 

Azimuth 

VIGS-First 

Elevation 

TGUN-First 

Elevation 


12  3  4 


Trial 
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tss 


Mean  Error  (Mils) 


— VIGS-First 
Rzimuth 

TGUN-First 
Rzimuth 

vtMt  VIGS'First 
Elevation 
— TGUN-First 
Elevation 


N-2 


Mean  Times  to  Fire  and  Kill  -for  TOPGUN 
and  VIGS-First  Groups  Rcross  Trials  i or 

TOPGUN 

can  Time  (Secs) 

. 

Ai*  ■  •  <  • ,  * . . . . . . . . . . 

••••■VIGS-First 

. — - - 

Kill 

. . TGUN-First 

Kill 

Fire 

— TGUN-First 

Mean  Times  to  Fire  and  Kill  for  TOPGUN 
and  VIGS-First  Groups  Rcross  Trials  for 

VI GS 


VIGS-First 

Kill 

TGUN-First 

Kill 

VIGS-First 

Fire 

TGUN-First 

Fire 


1  2  3  4 


Trial 
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Mean  Performance  Scores  for  TOPGUN 
and  VIGS-First  Groups  Across  Trials  for 

TOPGUN 


. VIGS-First 

SCORE 

— TGUN-First 
SCORE 
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Mean  Hit  Percentages  -for  TOPGUN 
and  VIGS-First  Groups  Rcross  Trials  tor 

V1GS 


VIGS-First 
Hit  */. 

TGUN-First 
Hit  * 


Trial 
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Appendix  0 

Raw  Data  for, ICOFT  by  Dependent  Variable,  Group,  and  Exercise 


SUBNUM 

GROUP 

ICEXNUM 

ICFIRE 

ICKILL 

ICERROR 

ICVGRADE 

ICBITPC 

1 

0.0 

31211 

17.7 

17.3 

0 

2.00 

100.00 

1 

0.0 

31311 

13.4 

14.9 

6 

2.00 

44.44 

1 

0.0 

32261 

14.5 

16.7 

0 

2.00 

87.50 

1 

0.0 

32321 

17.7 

21.2 

4 

2.00 

50.00 

1 

0.0 

3321  1 

19.3 

18.1 

4 

2.00 

88.89 

1 

0.0 

3331  1 

15.4 

19.5 

12 

1 .00 

66.67 

2 

0.0 

31211 

14.9 

15.4 

0 

3.00 

100.00 

2 

0.0 

31311 

17.6 

21.3 

4 

1.00 

36.36 

2 

0.0 

32261 

13.4 

17.6 

4 

2.00 

83.33 

2 

0.0 

32321 

19.1 

17.8 

4 

2.00 

40.00 

2 

0.0 

3321  1 

16.5 

20.5 

0 

2.00 

83.33 

2 

0.0 

3331  1 

19.0 

21.2 

7 

1 .00 

60.00 

3 

0.0 

3121 1 

18.4 

18.8 

6 

2.00 

66.67 

3 

0.0 

31311 

15.8 

19.3 

0 

2.00 

33.33 

3 

0.0 

32261 

18.8 

16.4 

0 

2.00 

77.78 

3 

0.0 

32321 

16.6 

19.2 

8 

1 .00 

28.57 

3 

0.0 

3321  1 

18.0 

18.7 

3 

2.00 

72.73 

3 

0.0 

3331  1 

15.6 

18.3 

10 

1.00 

60.00 

4 

0.0 

31211 

14.7 

15.1 

4 

2.00 

71.43 

4 

0.0 

31311 

14.2 

17.5 

4 

2.00 

26.67 

4 

0.0 

32261 

17.6 

20.1 

0 

2.00 

17.50 

4 

0.0 

32321 

15.3 

0.0 

4 

1 . 00 

0.0 

4 

0.0 

3321  1 

20.6 

22.7 

3 

2.00 

81.82 

4 

0.0 

3331  1 

22.1 

21 .0 

3 

1 .00 

70.00 

5 

0.0 

31211 

14.3 

17.1 

0 

3.00 

70.00 

5 

0.0 

31311 

19.7 

17.2 

6 

1.00 

22.22 

5 

0.0 

32261 

14.2 

16.1 

4 

2.00 

62.50 

5 

0.0 

32321 

14.0 

16.6 

4 

1.00 

0.0 

5 

0.0 

3321  1 

17.4 

19.8 

3 

2.00 

81.82 

5 

0.0 

3331  1 

14.4 

13.2 

1 1 

1.00 

11.11 

6 

0.0 

3121  1 

16.1 

18.0 

0 

3.00 

88.89 

6 

0.0 

31311 

14.4 

14.6 

0 

2.00 

63.64 

6 

0.0 

32261 

11.1 

13.5 

0 

3.00 

62.50 

6 

0.G 

32321 

17.5 

18.1 

0 

1  . 00 

16.67 

6 

0.0 

3321  1 

21.7 

20.6 

0 

2.00 

72.73 

6 

0.0 

3331  1 
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APPENDIX  P 


Subject  Comments 


TOPGUN  Comments 

1 .  TOPGUN  was  easier  than  ICOFT  as  far  as  being  able  to  spot 
targets.  ICOFT' s  vision  screen  was  npt  very  good. 

2.  I  feel  the  TOPGUN  simulator  was  at  some  times  inconsistent. 
What  worked  on  the  shot  before  did  not  always  work  on  the  next 
shot . 

3.  The  TOPGUN  simulator  trains  the  operator  to  aim  a  little 
high . 

4.  I  had  a  good  time  and  got  some  good  information  and  knowledge 
out  of  it. 

5.  I  really  liked  it,  but  the  real  one  was  phenomenally  harder 
than  the  TOPGUN. 

6.  I  thought  the  TOPGUN  was  not  difficult  enough  to  provide  a 
good  basis  for  performance  on  ICOFT. 

7.  The  controls  on  ICOFT  were  a  little  more  sensitive  than 
TOPGUN. 

8.  Thought  the  secondary  sight  with  the  numbered  reticle  was 
more  accurate  even  with  having  it  to  lead  moving  targets. 

9.  I  think  that  the  biggest  benefit  from  TOPGUN  was  learning  to 
feel  the  controls,  not  the  actual  targets. 

10.  Lost  the  effect  of  having  to  use  one  eye  in  sight,  which 
also  makes  the  controls  tougher  to  find  in  a  hurry. 

11.  TOPGUN  helped  in  training  for  the  Cadillacs  but  the  screen 
should  have  been  changed  to  more  resemble  the  ICOFT.  Also,  the 
first  simulators  [part-task]  needed  to  be  modified  to  act  (jump 
around)  like  the  GE  version. 

12.  TOPGUN  was  too  easy.  There  should  have  been  a  much  more 
rigorous  setup  as  you  advance  through  the  TOPGUN  program. 
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VIGS  Comments 


1 .  VIGS  was  more  closely  related  to  ICOFT  than  TOPGUN.  Also  I 
had  a  hard  time  tracking  targets  on  VIGS.  Some  targets  I  thought 
I  was  zeroed  in  on,  I  missed  completely. 

2.  Out  of  the  two,  at  first,  I  would  say  VIGS  was  the  more 
realistic.  The  intensity  and  grading; system  helped. 

3.  VIGS  was  harder  than  TOPGUN,  I  thought,  but  the  ICOFT  blew 
both  of  them  away. 

4.  VIGS  is  much  better  than  TOPGUN,  however  it  is  still  far  from 
ICOFT.  It  may  be  better  if  we  can  wear  a  headset  when  we  work  up 
with  VIGS.  Moreover,  the  training  of  condition  with  ICOFT  is  much 
different  (dark  and  hot  rooms). 

5.  VIGS  shares  many  similarities  with  ICOFT. 

6.  THe  ICOFT  was  very  different  from  VIGS.  The  controls  are  in 
different  places  and  the  commander  voice  on  ICOFT  was  almost 
completely  not  understandable.  In  a  real  life  situation,  or  for  a 
more  realistic  experiment,  much  more  training  is  needed  to  be 
done  before  practicing  on  ICOFT.  The  movement  over  the  hills  that 
ICOFT  does  is  very  important  and  some  prior  training  would  have 
been  very  helpful. 

7.  I  liked  VIGS  because  I  felt  it  was  more  intense  and 
challenging . 

8.  I  actually  preferred  the  VIGS  training  to  ICOFT.  I  felt  that 
the  fact  that  both  tanks  moved  made  a  more  realistic  mission.  It 
also  made  it  more  challenging. 

9.  The  VIGS  system  was  more  similar  to  the  ICOFT  in  that  it  used 
the  monocular  view  finder. 

10.  Once  again  I  thought  that  "VIGS"  was  much  too  easy,  it 
should  involve  a  much  harder  starting  stage  and  become 
increasingly  more  difficult  as  you  proceed. 

11.  If  you  could  let  the  trainee  listen  to  the  voice  saying  most 
of  the  command  words,  it  would  allow  the  trainee  to  get  used  to 
the  voice. 

12.  VIGS  was  a  good  simulator  of  ICOFT.  I  believe  that  the 
printout  is  a  good  motivational  factor  and  training  aid. 
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APPENDIX  Q 


TOPGUN  and  VIGS  Device  Deficiencies 
Found  During  the  Transfer  Study 

TOPGUN 

1.  The  engagements  on  TOPGUN  are  generally  too  easy. 

2.  The  kill  zone  (100%)  is  too  easy/liberal. 

3.  The  second  target  in  the  scenario  is  not  "noticed"  by  the 
artificial  TC. 

4.  TOPGUN  says  "cease  fire"  twice  when  the  "moving  ammo"  message 
is  displayed. 

5.  Minimal  lead  is  sometimes  necessary  even  in  primary  and 
thermal  moving  engagements. 

6.  Occasionally,  even  though  the  round  is  seen  as  hitting  the 
target,  no  effect  is  realized  (the  target  is  not  killed). 

Data  Coding  Issues 

1.  Reticle  Aim  (azimuth  and  elevation)  figures  are  sometimes 
greater  when  the  subject  hits  the  target  than  when  the 
subject  misses. 

2.  The  azimuth  and  elevation  criteria  to  hit  the  presented 
targets  are  not  consistent. 

VIGS 

1.  VIGS  differs  in  the  fire  commands  from  TOPGUN,  giving  a 
second  "fire"  signal  when  multiple  targets  are  presented. 

2.  VIGS  has  numerous  trees  in  the  display;  this  affects  the 
subjects'  ability  to  hit  targets  as  well  as  the  timing  of 
various  parameters. 

3.  Scenario  images  must  occasionally  be  clarified. 

4.  VIGS  has  periodic  "glitches",  in  which  the  screen  freezes  and 

shakes,  while  the  subject  is  not  given  the  opportunity  to 

complete  the  engagement.  Also,  VIGS  sometimes  records  false 
operator  errors  such  as  "firing  before  fire  command"  when  the 
opposite  is  true. 

5.  On  certain  missions  (18,  25)  VIGS  tends  to  shoot  high. 

Data  coding  issues 

1.  When  subjects  hit  the  wrong  target  first,  VIGS  gives 
erroneous  readings  (showing  more  than  one  hit  per  target). 

2.  Data  scrolls  off  the  screen  when  the  subject  fires  more  than 

five  rounds  per  mission.  In  that  case,  azimuth  and  elevation 

readings  are  lost. 

3.  The  azimuth  and  elevation  criteria  to  hit  the  presented 
targets  are  not  consistent. 
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